-- Logs begin at Wed 2022-06-15 13:46:35 UTC, end at Wed 2022-06-15 15:18:56 UTC. -- Jun 15 14:40:55.367234 dv-cinder-787296-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:40:55.376905 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:40:55 2022] *** Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: nodename: dv-cinder-787296-10-iscsi Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: machine: x86_64 Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: clock source: unix Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: pcre jit disabled Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: detected number of CPU cores: 4 Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: current working directory: / Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:40:55.379380 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: your processes number limit is 47680 Jun 15 14:40:55.380199 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: your memory page size is 4096 bytes Jun 15 14:40:55.380199 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: detected max file descriptor number: 2048 Jun 15 14:40:55.380199 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: lock engine: pthread robust mutexes Jun 15 14:40:55.380199 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: thunder lock: enabled Jun 15 14:40:55.380199 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:40:55.380199 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:40:55.423743 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: Python main interpreter initialized at 0x559786a499c0 Jun 15 14:40:55.423743 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: python threads support enabled Jun 15 14:40:55.423743 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: your server socket listen backlog is limited to 100 connections Jun 15 14:40:55.423743 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:40:55.424076 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:40:55.424200 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: *** Operational MODE: preforking *** Jun 15 14:40:55.424424 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:40:55.424424 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: spawned uWSGI master process (pid: 110221) Jun 15 14:40:55.424617 dv-cinder-787296-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:40:55.427059 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: spawned uWSGI worker 1 (pid: 110222, cores: 1) Jun 15 14:40:55.427059 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: spawned uWSGI worker 2 (pid: 110223, cores: 1) Jun 15 14:40:55.427059 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:40:56.095691 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:40:56.097941 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:40:57.280101 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:40:57.280101 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: from cryptography.utils import int_from_bytes Jun 15 14:40:57.280758 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:40:57.280758 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: from cryptography.utils import int_from_bytes Jun 15 14:40:57.295647 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:40:57.295647 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: from cryptography.utils import int_from_bytes Jun 15 14:40:57.296180 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:40:57.296180 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: from cryptography.utils import int_from_bytes Jun 15 14:40:59.933913 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:40:59.934442 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:40:59.934605 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:40:59.934955 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:40:59.935207 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:40:59.935594 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.935918 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.936262 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.936584 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.936912 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.937223 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.937544 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.937863 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.938195 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.938449 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.938767 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.939087 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-10-iscsi {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.939407 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.939712 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.940018 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.940359 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.940689 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.941006 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.941308 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.941804 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.942243 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.942552 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.942860 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.943198 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.943518 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.943811 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.944151 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.944254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:40:59.944609 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.944687 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:40:59.944761 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.944989 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:40:59.945098 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.945343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:40:59.945446 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-10-iscsi {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.945590 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:40:59.945745 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.945970 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.946069 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.946286 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.946388 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.946600 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.946751 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.946912 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.947063 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.947249 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.947389 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.947531 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.947688 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.947844 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.948018 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.948164 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.948368 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.948488 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.948694 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.948794 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.949012 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.949110 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.949329 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.949473 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-10-iscsi {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.949640 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.949727 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.949940 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.950026 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.950239 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.950331 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.950544 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.950629 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.950839 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.950931 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.951150 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.951248 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.951446 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.951538 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.951690 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.951934 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.952040 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.952262 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.952359 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.952566 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.952660 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.952868 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.952955 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.953180 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.953282 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.953449 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.953563 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.953746 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.953855 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.954062 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.954158 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.954363 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.954471 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.954662 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.954764 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.954959 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.955047 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.955260 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.955431 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-10-iscsi {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.955562 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.955650 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.955864 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.955959 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.956264 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.956583 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.956684 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.956774 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.956896 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.956989 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.957269 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.957375 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.957581 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.957685 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.957891 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.957991 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.958192 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.958291 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.958521 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.958620 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.958835 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.958930 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.959141 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.959229 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.959453 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.959551 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.959749 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.959837 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.960051 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.960201 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.960399 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.960485 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.960680 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.960776 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.960981 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.961087 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.961276 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.961375 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.961520 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.961619 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.961821 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.961909 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.962135 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.962222 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.962452 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.962553 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.962724 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.962818 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963001 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963089 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963244 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963335 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963554 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963654 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963866 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.963955 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.964191 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.964295 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.964493 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.964582 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.964796 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.964890 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.965098 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.965200 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.965398 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.965486 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.965698 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.965787 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.965997 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.966086 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.966295 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.966389 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.966596 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.966696 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.966900 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.966994 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.967206 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.967300 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.967503 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.967653 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.967814 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.967910 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.968150 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.968239 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.968466 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.968567 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.968764 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.968852 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.969062 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.969167 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.969366 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.969471 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.969682 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.969771 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.969989 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.970077 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.970291 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.970388 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.970590 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.970683 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.970890 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.970984 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.971192 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.971322 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.971501 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.971596 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.972356 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.972471 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.972657 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.972751 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.972903 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.973076 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.973198 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.973380 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.973497 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.973685 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.973810 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.974003 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.974111 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.974312 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.974409 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.974617 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.974704 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.974920 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.975015 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.975226 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.975323 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.975530 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.975625 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.975832 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.975927 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.976154 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.976322 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.976460 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.976614 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.976771 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.976918 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.977082 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.977245 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.977396 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.977546 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.977670 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.977808 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.977907 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.978001 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.978205 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.978301 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.978506 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.978600 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.978804 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.978893 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.979101 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.979238 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.979401 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.979490 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.979711 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.979800 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.980011 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.980159 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.980334 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.980464 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.980647 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.980784 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.980946 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.981097 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.981243 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.981410 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.981551 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.981735 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.981850 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.982047 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.982140 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.982357 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.982454 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.982667 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.982763 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.982982 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.983070 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.983299 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.983387 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.983596 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.983682 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.983893 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.983983 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.984217 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.984309 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.984516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.984615 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.984812 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.984917 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.985107 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.985195 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.985400 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.985488 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.985694 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.985790 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.985985 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.986080 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.986290 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.986385 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.986602 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.986703 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.986904 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.986999 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.987202 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.987421 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.988159 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.988314 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.988478 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:40:59.988808 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.988911 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.989125 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.989214 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.989439 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.989528 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.989759 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.989860 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.990085 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.990181 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.990396 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.990491 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.990707 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.990794 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.991013 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.991116 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.991325 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.991490 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.991656 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.991785 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.991936 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.992059 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.992677 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.992800 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.992908 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993015 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993124 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993245 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993362 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993477 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993591 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993699 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993805 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.993925 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.994075 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.994191 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.994387 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.994503 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996493 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996579 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996657 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996731 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996814 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996904 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.996975 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997040 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997116 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997197 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997287 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997376 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997465 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997553 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997633 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997711 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997789 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997876 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.997956 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998035 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998169 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998258 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998364 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998446 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998526 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998687 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.998801 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.999010 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.999108 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.999315 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.999406 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.999625 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.999721 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:40:59.999933 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.000031 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.000262 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.000362 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.000567 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.000656 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.000872 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.000970 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.001177 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.001321 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.001501 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.001662 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.001799 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.001949 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.002109 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.002249 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.002412 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.002551 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.002719 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.002872 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.003086 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.003242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.003384 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.003675 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.003828 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.003977 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.004176 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.004315 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.004454 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.004594 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.004690 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.004865 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.005009 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.005164 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.005262 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.005479 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.005629 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.005798 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.005900 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.006096 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.006186 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.006420 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.006527 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.006717 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.006818 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.007015 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.007110 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.007318 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.007415 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.007621 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.007711 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.007919 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.008023 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.008249 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.008341 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.008550 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.008637 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.008847 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.008939 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.009147 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.009249 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.009449 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.009538 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.009746 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.009842 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.010062 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.010159 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.010360 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.010448 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.010660 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.010756 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.010961 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.011051 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.011262 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.011359 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.011567 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.011664 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.011875 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.011973 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.012207 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.012313 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.012528 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.012626 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.012839 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.012929 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.013148 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.013238 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.013478 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.013567 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.013793 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.013881 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.014092 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.014180 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.014402 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.014500 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.014710 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.014839 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.015272 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.015363 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.015570 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.015658 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.015875 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.015964 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.016198 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.016291 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.016499 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.016590 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.016797 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.016887 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.017101 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.017203 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.017401 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.017490 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.017699 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.017795 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.017997 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.018096 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.018295 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.018430 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.018624 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.018746 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.018933 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.019184 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.019273 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.019509 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.019597 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.019807 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.019895 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.020142 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.020236 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.020450 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.020540 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.020747 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.020844 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.021058 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.021154 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.021370 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.021466 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.021689 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.021786 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.021998 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.022087 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.022304 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.022393 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.022613 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.022716 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.022916 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.023004 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.023221 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.023309 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.023527 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.023624 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.023828 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.023916 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.024169 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.024325 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.024477 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.024576 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.024793 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.024891 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.025100 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.025200 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.025407 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.025496 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.025709 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.025797 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.026024 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.026112 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.026320 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.026409 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.026630 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.026718 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.026936 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.027024 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.027241 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.027331 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.027551 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.027639 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.027866 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.027954 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.028195 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.028288 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.028505 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.028591 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.028806 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.028911 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.029111 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.029200 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.029416 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.029506 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.029719 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.029820 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.030024 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.030113 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.030327 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.030421 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.030640 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.030742 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.030944 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.031040 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.031260 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.031349 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.031564 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.031662 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.031870 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.031957 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.032194 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.032284 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.032503 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.032604 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.032817 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.032911 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.033120 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.033209 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.033425 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.033521 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.033728 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.033815 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.034043 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.034674 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.034920 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.035038 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.035272 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.035423 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.035555 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.035644 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.035854 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.035944 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.036190 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.036284 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.036507 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.036607 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.036820 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.036918 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.037128 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.037217 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.037435 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.037531 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.037736 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.037832 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.038042 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.038130 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.038343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.038439 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.038668 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.038764 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.038945 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.039071 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.039248 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.039369 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.039566 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.039675 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.039871 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.039959 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.040206 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.040311 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.040518 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.040606 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.040815 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.040902 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.041116 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.041206 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.041430 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.041518 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.041732 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.042001 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.042103 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.042322 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.042424 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.042622 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.042718 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.042942 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.043038 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.043249 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.043345 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.043550 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.043638 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.043861 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.043952 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.044200 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.044293 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.044506 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.044596 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.044814 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.044916 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.045117 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.045262 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.045423 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.045513 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.045727 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.045824 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.046036 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.046123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.046336 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.046432 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.046641 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.046738 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.046943 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.047030 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.047244 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.047339 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.047546 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.047643 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.047850 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.047945 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.048171 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.048262 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.048478 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.048576 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.048782 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.048880 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.049077 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.049165 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.049380 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.049470 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.049681 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.049890 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.050546 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.050785 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.050890 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.051114 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.051210 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.051427 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.051525 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.051727 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.051834 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.052055 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.052193 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.052387 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.052497 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.052711 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.052824 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.053034 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.053146 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.053368 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.053474 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.053671 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.053769 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.053974 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.054070 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.054272 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.054368 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.054571 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.054678 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.054874 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.054970 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.055174 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.055310 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.055674 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.055801 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.055887 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.055969 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.056072 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.056186 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.056392 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.056496 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.056691 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.056781 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.056989 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.057086 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.057287 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.057386 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.057586 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.057675 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.057881 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.057969 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.058183 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.058280 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.058477 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.058573 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.058810 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.058952 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.059116 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.059206 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.059379 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.059469 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.059676 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.059763 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.059975 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.060074 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.060302 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.060391 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.060613 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.060703 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.060917 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.061007 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.061230 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.061320 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.061534 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.061632 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.061837 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.061934 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.062138 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.062228 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.062448 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.062549 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.062743 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.062830 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.063041 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.063129 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.063338 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.063437 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.063642 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.063730 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.063940 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.064028 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.064258 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.064362 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.064565 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.064654 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.064865 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.064959 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.065166 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.065254 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.065515 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.065639 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.065808 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.065907 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.066173 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.066270 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.066478 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.066575 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.066789 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.066878 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.067090 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.067180 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.067387 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.067476 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.067686 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.067782 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.067989 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.068079 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.068315 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.068403 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.068610 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.068716 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.068915 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.069060 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.069209 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.069297 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.069510 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.069611 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.069803 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.069892 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.070102 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.070200 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.070398 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.070502 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.070701 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.070796 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.071011 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.071156 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.071296 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.071397 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.071610 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.071700 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.071914 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.072003 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.072238 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.072331 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.072537 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.072626 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.072838 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.072939 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.073135 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.073233 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.073431 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.073520 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.073734 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.073828 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.074047 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.074137 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.074358 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.074445 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.074653 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.074740 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.074956 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.075053 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.075256 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.075345 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.075551 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.075651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.075851 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.075942 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.076178 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.076270 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.076478 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.076578 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.076775 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.076872 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.077072 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.077161 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.077367 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.077469 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.077662 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.077750 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.077976 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.078066 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.078279 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.078377 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.078578 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.078679 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.078876 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.078965 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.079174 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.079282 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.079480 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.079576 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.079789 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.079877 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.080122 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.080225 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.080437 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.080526 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.080748 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.080837 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.081570 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.081713 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.081889 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.082022 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.082197 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.082296 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.082502 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.082624 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.082825 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.082914 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.083135 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.083225 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.083438 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.083528 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.083748 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.083837 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.084051 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.084178 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.084386 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.084477 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.084690 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.084780 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.085002 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.085119 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.085309 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.085431 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.085624 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.085740 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.085941 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.086042 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.086257 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.086347 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.086555 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.086643 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.086858 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.086957 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.087164 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.087265 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.087466 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.087563 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.087770 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.087927 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.088072 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.088265 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.088403 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.088575 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.088711 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.088890 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.089018 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.089194 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.089322 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.089496 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.089626 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.089803 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.089926 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.090123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.090225 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.090426 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.090525 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.090728 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.090817 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.091030 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.091125 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.091350 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.091439 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.091652 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.091790 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.091971 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.092060 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.092294 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.092415 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.092599 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.092730 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.092897 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.093035 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.093319 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.093449 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.093629 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.093761 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.093938 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.094068 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.094241 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.094388 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.094548 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.094710 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.094853 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.095030 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.095163 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.095333 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.095470 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.095644 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.095769 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.095953 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.096201 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.096294 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.096510 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.096640 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.097520 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.097642 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.097764 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.097882 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.098070 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.098190 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.098393 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.098492 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.098722 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.098811 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.099034 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.099122 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.099354 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.099443 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.099659 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.099768 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.099955 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.100121 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.100303 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.100423 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.100603 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.100732 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.100917 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.101056 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.101323 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.101420 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.101628 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.101725 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.101925 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.102027 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.102234 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.102322 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.102538 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.102636 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.102858 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.102953 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.103162 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.103251 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.103469 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.103559 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.103779 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.103866 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.104120 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.104226 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.104411 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.104500 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.104712 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.104799 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.105027 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.105125 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.105330 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.105466 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.105633 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.105721 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.105942 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.106065 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.106240 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.106337 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.106555 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.106644 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.106856 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.106953 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.107164 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.107257 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.107473 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.107568 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.107776 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.107865 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.108098 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.108196 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.108411 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.108502 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.108756 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.108846 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.109062 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.109150 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.109388 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.109501 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.109683 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.109774 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.109987 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.110085 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.110286 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.110423 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.110584 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.110682 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.110899 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.110988 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.111197 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.111296 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.111502 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.111593 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.111806 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.111894 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.112139 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.112291 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.112457 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.112548 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.112763 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.112861 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.113090 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.113196 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.113396 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.113486 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.113702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.113792 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114007 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114106 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114309 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114397 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114615 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114712 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114910 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.114999 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.115227 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.115318 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.115570 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.115670 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.115828 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.115918 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.116151 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.116281 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.116455 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.116556 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.116787 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.116896 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.117086 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.117186 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.117400 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.117498 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.117719 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.117817 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.118038 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.118135 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.118342 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.118453 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.118663 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.118768 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.118981 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.119079 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.119288 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.119395 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.119600 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.119706 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.119916 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.120005 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.120233 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.120340 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.120534 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.120633 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.120837 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.120936 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.121136 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.121235 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.121433 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.121523 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.121731 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.121820 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.122035 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.122126 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.122331 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.122428 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.122626 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.122716 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.122923 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.123013 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.123236 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.123464 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.123560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.123794 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.123892 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.124136 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.124229 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.124435 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.124526 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.124735 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.124839 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.125032 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.125122 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.125349 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.125446 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.125647 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.125738 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.125958 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.126045 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.126270 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.126381 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.126581 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.126681 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.126899 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.126996 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.127204 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.127295 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.127520 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.127612 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.127829 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.127967 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.128239 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.128342 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.128522 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.128612 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.128834 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.128924 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.129143 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.129241 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.129453 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.129556 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.129761 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.129867 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.130063 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.130165 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.130371 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.130461 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.130681 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.130779 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.130990 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.131080 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.131302 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.131763 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.131884 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.131970 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.132061 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.132225 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.132313 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.132437 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.132528 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.132745 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.132852 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.133052 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.133142 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.133359 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.133449 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.133662 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.133753 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.133965 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.134057 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.134268 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.134358 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.134574 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.134667 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.134895 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.134985 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.135209 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.135300 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.135527 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.135741 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.135854 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.136057 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.136203 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.136413 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.136503 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.136740 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.136849 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.137060 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.137150 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.137375 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.137465 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.137690 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.137780 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.137989 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.138084 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.138296 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.138387 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.138604 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.138693 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.138911 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.139008 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.139216 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.139305 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.139516 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.139603 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.139820 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.140215 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.140424 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.140513 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.140730 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.140817 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.141031 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.141133 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.141337 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.141427 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.141642 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.141862 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.142024 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.142208 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.142298 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.142524 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.142620 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.142847 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.142946 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.143154 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.143251 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.143460 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.144075 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.144409 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.144574 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.144735 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.144943 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.145032 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.145271 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.145361 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.145590 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.145681 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.145909 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.145999 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.146220 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.146323 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.146523 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.146620 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.146835 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.146936 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.147132 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.147230 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.147431 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.147523 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.147736 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.147825 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.148040 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.148161 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.148364 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.148455 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.148681 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.148768 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.148982 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.149078 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.149281 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.149370 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.149589 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.149683 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.149888 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.149976 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.150186 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.150406 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.150502 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.150747 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.150845 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.151059 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.151224 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.151357 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.151447 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.151665 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.151767 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.151968 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.152064 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.152301 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.152390 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.152601 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.152700 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.152904 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.152992 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.153204 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.153293 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.153514 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.153604 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.153818 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.153907 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.154117 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.154205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.154416 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.154507 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.154721 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.154809 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.155024 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.155112 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.155321 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.155415 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.155622 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.155712 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.155920 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.156009 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.156264 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.156356 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.156567 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.156805 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.156954 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.157139 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.157230 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.157445 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.157533 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.157745 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.157834 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.158043 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.158133 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.158338 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.158427 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.158633 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.158721 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.158937 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.159034 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.159844 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.159945 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.160174 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.160442 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.160545 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.160629 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.160766 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.160856 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.161065 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.161173 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.161369 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.161459 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.161678 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.161766 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.161986 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.162089 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.162294 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.162384 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.162589 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.162676 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.162894 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.162995 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.163197 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.163285 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.163500 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.163589 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.163803 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.163892 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.164123 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.164216 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.164462 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.164552 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.164768 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.164864 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.165081 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.165288 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.165378 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.165616 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.165714 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.165931 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.166049 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.166257 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.166374 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.166568 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.166666 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.166868 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.166956 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.167168 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.167267 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.167466 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.167557 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.167782 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.167879 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.168096 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.168189 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.168410 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.168523 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.168715 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.168835 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.169019 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.169155 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.169322 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.169473 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.169623 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.169781 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.169925 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.170099 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.170228 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.170419 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.170518 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.170730 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.170828 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.171060 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.171197 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.171361 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.171450 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.171676 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.171764 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.171983 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.172077 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.172343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.172434 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.172655 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.172755 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.172958 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.173055 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.173260 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.173356 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.173563 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.173661 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.173863 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.173959 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.174166 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.174256 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.174470 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.174567 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.174790 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.174886 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.175098 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.175187 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.175410 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.175522 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.175706 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.175796 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.176002 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.176117 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.176336 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.176426 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.176636 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.176782 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.176942 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.177033 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.177242 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.177342 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.177541 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.177630 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.177845 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.177943 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.178146 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.178236 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.178447 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.178544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.178745 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.178844 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.179050 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.179139 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.179348 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.179444 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.179647 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.179746 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.179945 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.180035 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.180274 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.180367 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.180574 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.180672 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.180902 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.180999 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.181206 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.181302 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.181509 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.181599 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.181819 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.181917 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.182127 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.182216 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.182423 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.182520 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.182720 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.182810 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.183022 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.183111 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.183320 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.183411 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.183615 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.183704 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.183910 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.184042 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.184228 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.184319 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.184529 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.184618 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.184823 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.184922 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.185117 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.185206 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.185411 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.185499 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.185706 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.185803 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186001 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186090 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186295 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186383 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186594 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186891 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.186985 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.187186 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.187283 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.187481 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.187584 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.187776 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.187865 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.188070 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.188190 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.188415 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.188506 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.188738 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.188827 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.189045 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.189134 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.189360 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.189459 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.189664 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.189754 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.189977 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.190067 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.190279 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.190472 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.190617 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.190714 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.190926 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.191049 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.191234 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.191384 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.191536 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.191714 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.191850 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.192031 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.192166 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.192387 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.192477 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.192716 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.192807 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.193049 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.193138 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.193353 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.193442 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.193660 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.193757 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.193983 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.194105 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.194303 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.194400 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.194605 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.194707 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.194909 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.194997 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.195153 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:41:00.195242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.195522 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.195833 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.196162 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.196488 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.196795 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.197100 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.197411 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.197715 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.198021 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.198330 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.198639 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.198959 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.199278 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.199582 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.199901 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.200244 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.200587 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.200895 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.201249 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.201553 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.201861 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.202173 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.202475 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:41:00.202714 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:41:00.256447 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Registered counter for database nova_api Jun 15 14:41:00.264215 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Registered counter for database nova_api Jun 15 14:41:00.276890 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.283544 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.286609 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.292974 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.342930 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.context [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62f88910-6aa4-41b0-a16b-3521d73e0cca(cell1) {{(pid=110223) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:41:00.347623 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:00.349262 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:00.350062 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:00.350823 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.context [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62f88910-6aa4-41b0-a16b-3521d73e0cca(cell1) {{(pid=110222) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:41:00.352037 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:00.354036 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Registered counter for database nova_cell0 Jun 15 14:41:00.354878 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:00.356461 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:00.357247 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:41:00.357883 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Registered counter for database nova_cell1 Jun 15 14:41:00.359227 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:41:00.361205 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Registered counter for database nova_cell0 Jun 15 14:41:00.365664 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Registered counter for database nova_cell1 Jun 15 14:41:00.365964 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.368542 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.372761 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.373122 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.374783 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.381212 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.383864 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.512265 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.522840 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Registered counter for database nova_cell0 Jun 15 14:41:00.527784 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Registered counter for database nova_cell0 Jun 15 14:41:00.531359 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.535749 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.536608 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:41:00.541067 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:41:00.985709 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:41:00.993609 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:41:01.000229 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:41:01.008135 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:41:01.336703 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:41:01.342627 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:41:01.347971 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559786a499c0 pid: 110223 (default app) Jun 15 14:41:01.350028 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:41:01.350613 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:41:01.351211 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Jun 15 14:41:01.351606 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Jun 15 14:41:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:41:01.356708 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-8177eb35-ec78-4802-9179-6e0f588ae1f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:41:01.361977 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559786a499c0 pid: 110222 (default app) Jun 15 14:42:21.896318 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:21.897434 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 15 14:42:21.897998 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:21.915922 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=3 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:21.917258 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell0:SELECT=3 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:21.918261 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell1:SELECT=3 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:21.918970 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:22.352495 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-a50b447b-ff90-4ce4-b804-a85f7f49dc49 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:22.383883 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-a50b447b-ff90-4ce4-b804-a85f7f49dc49 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478656 Jun 15 14:42:22.388123 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jun 15 14:42:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:24.586439 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:24.587435 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-a1fc305e-258c-4bc1-a047-c78b19ffca03 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 15 14:42:24.587827 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:24.656026 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-ea0e4e82-2e8a-4d35-ac72-0613c8b6f562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:24.677433 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:42:24.677433 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 15 14:42:24.762536 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-ea0e4e82-2e8a-4d35-ac72-0613c8b6f562 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.168346 Jun 15 14:42:24.763140 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:42:24.777225 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=3 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:24.778590 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell0:SELECT=3 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:24.779796 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell1:SELECT=3 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:24.780562 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:42:24.986966 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-8d67da12-dbcc-45d9-811f-c9bd3af6c5f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:24.989346 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:42:24.989346 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 15 14:42:25.117436 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-8d67da12-dbcc-45d9-811f-c9bd3af6c5f4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.345421 Jun 15 14:42:25.118257 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jun 15 14:42:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:42:27.355521 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-ea0e4e82-2e8a-4d35-ac72-0613c8b6f562 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:27.356665 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-ea0e4e82-2e8a-4d35-ac72-0613c8b6f562 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jun 15 14:42:27.357277 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:27.484000 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3a7c0475-720c-4db0-98cc-9eee7b1bc52b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:27.505868 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:42:27.505868 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 15 14:42:27.760397 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3a7c0475-720c-4db0-98cc-9eee7b1bc52b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.395884 Jun 15 14:42:27.760960 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:42:27.774013 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-01ff25c5-79f2-4dd4-9d45-cac24b72938d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:27.775659 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:42:27.775659 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 15 14:42:27.878087 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-01ff25c5-79f2-4dd4-9d45-cac24b72938d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107840 Jun 15 14:42:27.878684 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jun 15 14:42:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:30.086075 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3a7c0475-720c-4db0-98cc-9eee7b1bc52b admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:30.087083 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3a7c0475-720c-4db0-98cc-9eee7b1bc52b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 15 14:42:30.087493 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:30.152941 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-056b276f-a8ea-42dd-9527-a65ef19bb72c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:30.214758 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-056b276f-a8ea-42dd-9527-a65ef19bb72c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.121390 Jun 15 14:42:30.215411 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:42:30.227546 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-ad7cbeea-a425-445c-ab92-e0316d53108c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:30.314767 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-ad7cbeea-a425-445c-ab92-e0316d53108c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090846 Jun 15 14:42:30.315695 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jun 15 14:42:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:32.524156 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-056b276f-a8ea-42dd-9527-a65ef19bb72c admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:32.525205 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-056b276f-a8ea-42dd-9527-a65ef19bb72c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 15 14:42:32.525617 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:32.589357 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-e33b5b19-2721-4668-b555-60b5189a13e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "id": "d3", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:32.665015 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-e33b5b19-2721-4668-b555-60b5189a13e1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132966 Jun 15 14:42:32.665571 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:42:32.678348 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-e012b0ba-6439-4018-87a0-7c3f2f7dabf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:32.776162 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-e012b0ba-6439-4018-87a0-7c3f2f7dabf9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101385 Jun 15 14:42:32.776947 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jun 15 14:42:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:34.974601 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-e33b5b19-2721-4668-b555-60b5189a13e1 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:34.975619 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-e33b5b19-2721-4668-b555-60b5189a13e1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 15 14:42:34.976020 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:42:35.039364 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1c552dcb-00cf-40c8-91cb-4e7b3819bd6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:35.115062 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1c552dcb-00cf-40c8-91cb-4e7b3819bd6f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132874 Jun 15 14:42:35.115980 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:42:35.128357 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-04428a63-9fdc-4293-b75c-840a84b44147 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:35.227923 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-04428a63-9fdc-4293-b75c-840a84b44147 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103633 Jun 15 14:42:35.228591 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Wed Jun 15 14:42:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:37.456119 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1c552dcb-00cf-40c8-91cb-4e7b3819bd6f admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:37.457206 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1c552dcb-00cf-40c8-91cb-4e7b3819bd6f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 15 14:42:37.457795 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:37.533036 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-1668e394-7063-402e-a986-2c032a6bca5d admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:37.557494 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-1668e394-7063-402e-a986-2c032a6bca5d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.093743 Jun 15 14:42:37.558039 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jun 15 14:42:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:42:40.029111 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1c552dcb-00cf-40c8-91cb-4e7b3819bd6f admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:40.030443 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1c552dcb-00cf-40c8-91cb-4e7b3819bd6f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Jun 15 14:42:40.030980 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:40.095235 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-d06531ff-249d-4a4d-93cc-c24e2ad13889 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "ram": 512}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:40.169269 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-d06531ff-249d-4a4d-93cc-c24e2ad13889 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.129871 Jun 15 14:42:40.169955 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:42:40.186125 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-deddf3d7-43d2-4929-bdfb-3349d91c23fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:40.306665 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-deddf3d7-43d2-4929-bdfb-3349d91c23fb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125172 Jun 15 14:42:40.307273 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jun 15 14:42:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:42.493161 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-d06531ff-249d-4a4d-93cc-c24e2ad13889 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:42.494404 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-d06531ff-249d-4a4d-93cc-c24e2ad13889 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Jun 15 14:42:42.494849 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:42.571746 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-ff002b20-6ee4-41b7-ad1f-f6fea1fdbec4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:42.647003 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-ff002b20-6ee4-41b7-ad1f-f6fea1fdbec4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.145270 Jun 15 14:42:42.647586 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:42:42.661782 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-059b5fc2-79b4-44a2-acd6-accd426c64df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:42.731997 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-059b5fc2-79b4-44a2-acd6-accd426c64df admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075701 Jun 15 14:42:42.732673 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jun 15 14:42:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:45.316163 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-ff002b20-6ee4-41b7-ad1f-f6fea1fdbec4 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:45.317185 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-ff002b20-6ee4-41b7-ad1f-f6fea1fdbec4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 15 14:42:45.317743 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:45.383902 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-0d42b9f7-d907-48dd-84d7-011e88005613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:45.495026 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-0d42b9f7-d907-48dd-84d7-011e88005613 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.171477 Jun 15 14:42:45.495575 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:42:45.513204 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fefb9d64-1fb3-4f7e-b2f4-28563147f041 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:45.605079 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fefb9d64-1fb3-4f7e-b2f4-28563147f041 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099923 Jun 15 14:42:45.605667 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jun 15 14:42:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:42:47.880506 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-0d42b9f7-d907-48dd-84d7-011e88005613 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:47.881521 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-0d42b9f7-d907-48dd-84d7-011e88005613 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 15 14:42:47.881921 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:47.970196 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-0110b708-7b2a-49c1-b594-2c37ca476612 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:48.311743 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-0110b708-7b2a-49c1-b594-2c37ca476612 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422781 Jun 15 14:42:48.312818 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:42:48.330495 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-d82980f3-6f7f-479f-947b-2d69d4e2d3db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:48.404995 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-d82980f3-6f7f-479f-947b-2d69d4e2d3db admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079148 Jun 15 14:42:48.405667 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jun 15 14:42:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:42:50.712018 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-0110b708-7b2a-49c1-b594-2c37ca476612 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:42:50.713092 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-0110b708-7b2a-49c1-b594-2c37ca476612 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 15 14:42:50.714525 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:42:50.806694 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-9b6875c4-aaca-43e5-a5ee-d146e6579d49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:50.888062 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-9b6875c4-aaca-43e5-a5ee-d146e6579d49 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.163449 Jun 15 14:42:50.888903 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Wed Jun 15 14:42:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:42:50.904158 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-2fe513ca-c4d7-4a50-9985-4c59437d38c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:42:51.032262 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-2fe513ca-c4d7-4a50-9985-4c59437d38c3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131419 Jun 15 14:42:51.033206 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Wed Jun 15 14:42:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:43:16.064337 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-9b6875c4-aaca-43e5-a5ee-d146e6579d49 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:16.065472 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-9b6875c4-aaca-43e5-a5ee-d146e6579d49 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 15 14:43:16.065770 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:43:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:16.081823 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:16.134670 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-74ac019b-b7da-4208-8a7d-4f7b79bb9259 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:16.153262 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-74ac019b-b7da-4208-8a7d-4f7b79bb9259 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076925 Jun 15 14:43:16.153793 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jun 15 14:43:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:17.146237 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-9b6875c4-aaca-43e5-a5ee-d146e6579d49 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:17.147250 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-9b6875c4-aaca-43e5-a5ee-d146e6579d49 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 15 14:43:17.147675 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:17.357895 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-79e449fc-cc61-4704-93fc-8746d7c2db7a admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:17.364121 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.wsgi [None req-79e449fc-cc61-4704-93fc-8746d7c2db7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-79e449fc-cc61-4704-93fc-8746d7c2db7a admin admin] Request method failure captured: Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Accept: application/json Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Accept-Encoding: gzip, deflate Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Connection: keep-alive Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Content-Length: 0 Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Host: 10.222.0.42 Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Openstack-Api-Version: compute 2.90 Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Openstack-System-Scope: None Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: User-Agent: python-novaclient Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Auth-Token: gAAAAABiqfAFZuZUZ8wVPOX9oA1qU4GD76_mCaVLqGfNeGS8AR1e_vQbvQ20_Qcvb0dKSnTl_D-plcOn30D1BTm84gqXYmRfol03fBgntpDAR2W_tS-h4XFgifhG2rl8ZgIWuZOnvuQMKkXeZysQW0ZNzWdsoggDcO9f5iFy11EnH_JHO6EBh-M Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Domain-Id: None Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Domain-Name: None Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Identity-Status: Confirmed Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Is-Admin-Project: True Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Domain-Id: default Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Domain-Name: Default Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Name: admin Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Role: member,reader,admin Jun 15 14:43:17.367560 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Roles: member,reader,admin Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant: admin Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant-Name: admin Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User: admin Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Domain-Id: default Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Domain-Name: Default Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Id: 11d932a20a0f4d8b9ce5ee15655d936c Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Name: admin Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: method: > Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: exception: Flavor 42 could not be found. Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: action_args: {'id': '42'} Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:17.369219 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:17.370137 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.371252 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-79e449fc-cc61-4704-93fc-8746d7c2db7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:17.372551 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-79e449fc-cc61-4704-93fc-8746d7c2db7a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066679 Jun 15 14:43:17.372551 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jun 15 14:43:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 14:43:17.379280 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-17b95c7e-f0cb-4799-8695-e01f22cbb135 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:17.382254 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:43:17.402565 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-17b95c7e-f0cb-4799-8695-e01f22cbb135 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026737 Jun 15 14:43:17.403294 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jun 15 14:43:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:17.413390 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-b9cd5f42-c1bb-4008-a8b9-408531776762 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:17.435551 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-b9cd5f42-c1bb-4008-a8b9-408531776762 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025824 Jun 15 14:43:17.436128 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jun 15 14:43:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:17.446884 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-55451048-04f1-420a-8e69-81813f1f0e60 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:17.453793 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.wsgi [None req-55451048-04f1-420a-8e69-81813f1f0e60 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-55451048-04f1-420a-8e69-81813f1f0e60 admin admin] Request method failure captured: Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Accept: application/json Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Accept-Encoding: gzip, deflate Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Connection: keep-alive Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Content-Length: 0 Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Host: 10.222.0.42 Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Openstack-Api-Version: compute 2.90 Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Openstack-System-Scope: None Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: User-Agent: python-novaclient Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Auth-Token: gAAAAABiqfAFZuZUZ8wVPOX9oA1qU4GD76_mCaVLqGfNeGS8AR1e_vQbvQ20_Qcvb0dKSnTl_D-plcOn30D1BTm84gqXYmRfol03fBgntpDAR2W_tS-h4XFgifhG2rl8ZgIWuZOnvuQMKkXeZysQW0ZNzWdsoggDcO9f5iFy11EnH_JHO6EBh-M Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Domain-Id: None Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Domain-Name: None Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Identity-Status: Confirmed Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Is-Admin-Project: True Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Domain-Id: default Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Domain-Name: Default Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Name: admin Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Role: member,reader,admin Jun 15 14:43:17.457123 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Roles: member,reader,admin Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant: admin Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant-Name: admin Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User: admin Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Domain-Id: default Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Domain-Name: Default Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Id: 11d932a20a0f4d8b9ce5ee15655d936c Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Name: admin Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: method: > Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: exception: Flavor 42 could not be found. Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: action_args: {'id': '42'} Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:17.458696 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:17.459577 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:17.477504 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-55451048-04f1-420a-8e69-81813f1f0e60 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:17.478561 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-55451048-04f1-420a-8e69-81813f1f0e60 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015497 Jun 15 14:43:17.478561 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jun 15 14:43:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:43:18.362407 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-b9cd5f42-c1bb-4008-a8b9-408531776762 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:18.363410 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-b9cd5f42-c1bb-4008-a8b9-408531776762 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 15 14:43:18.363800 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:18.564552 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-aa363e1b-0d2f-4486-b5e9-e1ce849e5162 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.wsgi [None req-aa363e1b-0d2f-4486-b5e9-e1ce849e5162 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-aa363e1b-0d2f-4486-b5e9-e1ce849e5162 admin admin] Request method failure captured: Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Accept: application/json Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Accept-Encoding: gzip, deflate Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Connection: keep-alive Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Content-Length: 0 Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Host: 10.222.0.42 Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Openstack-Api-Version: compute 2.90 Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Openstack-System-Scope: None Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: User-Agent: python-novaclient Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Auth-Token: gAAAAABiqfAGHj5AWW2xTdASgLEa-KrUKKNt5xmFB57cISooXa_AC9P1jf7k6xuBLp7sE9OrSrshe6-DJ7kYs0D8e92zcTwrL1q8UZ9M8PgjfR6KzXXSr0FZaIIs7MM74ObF_h6moQNgr8nDdBq4G5FW-rFnTUFALLiQ9RqMK13hX04lUVtNRR8 Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Domain-Id: None Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Domain-Name: None Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Identity-Status: Confirmed Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Is-Admin-Project: True Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Domain-Id: default Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Domain-Name: Default Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Name: admin Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Role: member,reader,admin Jun 15 14:43:18.576651 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Roles: member,reader,admin Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant: admin Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant-Name: admin Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User: admin Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Domain-Id: default Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Domain-Name: Default Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Id: 11d932a20a0f4d8b9ce5ee15655d936c Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Name: admin Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: method: > Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: exception: Flavor 84 could not be found. Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: action_args: {'id': '84'} Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:18.579311 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:18.580205 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.581549 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-aa363e1b-0d2f-4486-b5e9-e1ce849e5162 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:18.582946 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-aa363e1b-0d2f-4486-b5e9-e1ce849e5162 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067982 Jun 15 14:43:18.582946 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jun 15 14:43:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:43:18.583726 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fc51f75e-ceb3-4d06-9ad7-52ab44d41b7b admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:18.600484 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fc51f75e-ceb3-4d06-9ad7-52ab44d41b7b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020556 Jun 15 14:43:18.601034 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jun 15 14:43:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:18.611380 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-b669fa29-24a1-45da-9313-61a496978931 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:18.625955 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-b669fa29-24a1-45da-9313-61a496978931 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018677 Jun 15 14:43:18.626501 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jun 15 14:43:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:18.636109 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-72345862-4105-460b-8e21-4d8b1c8a151c admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:18.642234 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.wsgi [None req-72345862-4105-460b-8e21-4d8b1c8a151c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-72345862-4105-460b-8e21-4d8b1c8a151c admin admin] Request method failure captured: Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Accept: application/json Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Accept-Encoding: gzip, deflate Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Connection: keep-alive Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Content-Length: 0 Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Host: 10.222.0.42 Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Openstack-Api-Version: compute 2.90 Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Openstack-System-Scope: None Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: User-Agent: python-novaclient Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Auth-Token: gAAAAABiqfAGHj5AWW2xTdASgLEa-KrUKKNt5xmFB57cISooXa_AC9P1jf7k6xuBLp7sE9OrSrshe6-DJ7kYs0D8e92zcTwrL1q8UZ9M8PgjfR6KzXXSr0FZaIIs7MM74ObF_h6moQNgr8nDdBq4G5FW-rFnTUFALLiQ9RqMK13hX04lUVtNRR8 Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Domain-Id: None Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Domain-Name: None Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Identity-Status: Confirmed Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Is-Admin-Project: True Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Domain-Id: default Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Domain-Name: Default Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Name: admin Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Role: member,reader,admin Jun 15 14:43:18.643755 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Roles: member,reader,admin Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant: admin Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant-Name: admin Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User: admin Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Domain-Id: default Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Domain-Name: Default Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Id: 11d932a20a0f4d8b9ce5ee15655d936c Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Name: admin Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: method: > Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: exception: Flavor 84 could not be found. Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: action_args: {'id': '84'} Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:18.645343 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:18.646357 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:18.647992 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-72345862-4105-460b-8e21-4d8b1c8a151c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:18.649408 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-72345862-4105-460b-8e21-4d8b1c8a151c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012743 Jun 15 14:43:18.649408 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Jun 15 14:43:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:43:19.527283 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-b669fa29-24a1-45da-9313-61a496978931 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:19.528348 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-b669fa29-24a1-45da-9313-61a496978931 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 15 14:43:19.528751 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:19.724869 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-c0dcc4d3-570a-43ca-815f-5a1673c772b9 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:19.731977 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.wsgi [None req-c0dcc4d3-570a-43ca-815f-5a1673c772b9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-c0dcc4d3-570a-43ca-815f-5a1673c772b9 admin admin] Request method failure captured: Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Accept: application/json Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Accept-Encoding: gzip, deflate Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Connection: keep-alive Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Content-Length: 0 Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Host: 10.222.0.42 Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Openstack-Api-Version: compute 2.90 Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Openstack-System-Scope: None Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: User-Agent: python-novaclient Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Auth-Token: gAAAAABiqfAHMySyd4IiIuYMUNWNXygI_E7nGRerqSmIZMj9u2VtGX3uNOXHU9rd0w1X2770hh6zy_e5WwCDDxod74Sf0AKs8t8Xjjn4B9fuoRIGXJcxZaru0JKGml2eoSXQKhQvu8GCkAXfJHMdesaS5cilWZ6DRxS34VJXHR5UbOtV5_ez1UY Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Domain-Id: None Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Domain-Name: None Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Identity-Status: Confirmed Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Is-Admin-Project: True Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Domain-Id: default Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Domain-Name: Default Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Project-Name: admin Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Role: member,reader,admin Jun 15 14:43:19.734516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Roles: member,reader,admin Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant: admin Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-Tenant-Name: admin Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User: admin Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Domain-Id: default Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Domain-Name: Default Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Id: 11d932a20a0f4d8b9ce5ee15655d936c Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: X-User-Name: admin Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: method: > Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: exception: Flavor 451 could not be found. Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: action_args: {'id': '451'} Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:19.736254 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:19.737242 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.738544 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-c0dcc4d3-570a-43ca-815f-5a1673c772b9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:19.739788 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-c0dcc4d3-570a-43ca-815f-5a1673c772b9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066190 Jun 15 14:43:19.740288 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jun 15 14:43:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:43:19.745519 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-b6b7f1ce-30fa-40aa-a604-f0c0c03bdc23 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:19.761091 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-b6b7f1ce-30fa-40aa-a604-f0c0c03bdc23 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019084 Jun 15 14:43:19.761848 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jun 15 14:43:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:19.771951 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:19.786945 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018794 Jun 15 14:43:19.787528 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Jun 15 14:43:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:43:19.797557 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-a69106cc-9092-4c57-9caa-465327ab7f12 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:19.803218 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.wsgi [None req-a69106cc-9092-4c57-9caa-465327ab7f12 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-a69106cc-9092-4c57-9caa-465327ab7f12 admin admin] Request method failure captured: Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Accept: application/json Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Accept-Encoding: gzip, deflate Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Connection: keep-alive Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Content-Length: 0 Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Host: 10.222.0.42 Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Openstack-Api-Version: compute 2.90 Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Openstack-System-Scope: None Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: User-Agent: python-novaclient Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Auth-Token: gAAAAABiqfAHMySyd4IiIuYMUNWNXygI_E7nGRerqSmIZMj9u2VtGX3uNOXHU9rd0w1X2770hh6zy_e5WwCDDxod74Sf0AKs8t8Xjjn4B9fuoRIGXJcxZaru0JKGml2eoSXQKhQvu8GCkAXfJHMdesaS5cilWZ6DRxS34VJXHR5UbOtV5_ez1UY Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Domain-Id: None Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Domain-Name: None Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Identity-Status: Confirmed Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Is-Admin-Project: True Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Domain-Id: default Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Domain-Name: Default Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Project-Name: admin Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Role: member,reader,admin Jun 15 14:43:19.805166 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Roles: member,reader,admin Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_688b80ae31764832aed9d6e0f3d3660f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant: admin Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant-Id: 688b80ae31764832aed9d6e0f3d3660f Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-Tenant-Name: admin Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User: admin Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Domain-Id: default Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Domain-Name: Default Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Id: 11d932a20a0f4d8b9ce5ee15655d936c Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: X-User-Name: admin Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: method: > Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: exception: Flavor 451 could not be found. Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: action_args: {'id': '451'} Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:43:19.806698 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:19.807580 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 15 14:43:19.808702 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-a69106cc-9092-4c57-9caa-465327ab7f12 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:43:19.809916 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-a69106cc-9092-4c57-9caa-465327ab7f12 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013485 Jun 15 14:43:19.809916 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jun 15 14:43:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:43:20.705272 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:20.706265 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 15 14:43:20.706653 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:20.911347 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-e32434b0-df4b-4fce-9839-8671a161ce3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:21.029765 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-e32434b0-df4b-4fce-9839-8671a161ce3a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.174850 Jun 15 14:43:21.030797 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jun 15 14:43:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:43:21.911007 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:21.911993 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 15 14:43:21.912409 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:22.106778 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-8aa19e0d-601f-4817-b25c-0b0dcfa755d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:22.185411 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-8aa19e0d-601f-4817-b25c-0b0dcfa755d9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.131701 Jun 15 14:43:22.185880 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jun 15 14:43:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:43:23.142505 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:23.143517 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jun 15 14:43:23.143925 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:23.354229 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4e812edb-f455-4d8c-9c0c-bb7f5524b1c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:23.462198 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4e812edb-f455-4d8c-9c0c-bb7f5524b1c5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.171111 Jun 15 14:43:23.462732 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jun 15 14:43:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:43:24.408593 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:24.409601 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 15 14:43:24.409996 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:43:24.609160 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-fedd42c4-1774-480e-9b76-65570fccbeba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:43:24.693248 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-fedd42c4-1774-480e-9b76-65570fccbeba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.142560 Jun 15 14:43:24.693717 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Jun 15 14:43:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:43:25.611641 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:25.612967 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 15 14:43:25.613374 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:43:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:43:25.818019 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-645024a6-ac47-4a73-b00a-0985ed1931dc admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:43:25.837691 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-645024a6-ac47-4a73-b00a-0985ed1931dc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078834 Jun 15 14:43:25.838237 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Jun 15 14:43:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:15.887327 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:15.889516 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-7e2ccab7-5ee7-49cb-8480-23689a465131 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002393 Jun 15 14:44:15.890218 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Wed Jun 15 14:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:44:15.908282 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:15.963798 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-f658db21-a763-4ad5-b483-15f1062dec7d admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:15.986901 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-f658db21-a763-4ad5-b483-15f1062dec7d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.086839 Jun 15 14:44:15.987468 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Wed Jun 15 14:44:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:44:16.015228 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-b9769762-f655-4991-b56c-6d29500c8d17 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.019791 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=14 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:44:16.025468 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-b9769762-f655-4991-b56c-6d29500c8d17 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017792 Jun 15 14:44:16.032204 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:16.048198 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-77eb1ce3-7009-4d87-996d-ed80d704ba36 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.061273 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-77eb1ce3-7009-4d87-996d-ed80d704ba36 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019003 Jun 15 14:44:16.062346 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:16.079622 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.094016 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021346 Jun 15 14:44:16.094945 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:44:16.108851 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-52f93815-47ca-47b7-846a-381d0a63568c admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:44:16.118632 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-52f93815-47ca-47b7-846a-381d0a63568c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013952 Jun 15 14:44:16.119284 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Wed Jun 15 14:44:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:00.228227 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:00.229232 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 15 14:48:00.229625 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:48:00.400883 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=6 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:00.552273 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-50d1a33c-8c3b-4bcd-a72d-3bda5613c821 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:00.554441 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:00.554441 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 15 14:48:00.556679 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-50d1a33c-8c3b-4bcd-a72d-3bda5613c821 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.557473 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-50d1a33c-8c3b-4bcd-a72d-3bda5613c821 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.558883 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-50d1a33c-8c3b-4bcd-a72d-3bda5613c821 admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:00.559664 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-50d1a33c-8c3b-4bcd-a72d-3bda5613c821 admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:00.604838 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-50d1a33c-8c3b-4bcd-a72d-3bda5613c821 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.205685 Jun 15 14:48:00.605629 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jun 15 14:48:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:48:01.535168 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:01.536222 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 15 14:48:01.536623 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:01.740907 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-508652cd-1085-4dd8-97b5-13f8017a6c4b admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:01.742148 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:01.742148 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 15 14:48:01.743364 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-508652cd-1085-4dd8-97b5-13f8017a6c4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.743798 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-508652cd-1085-4dd8-97b5-13f8017a6c4b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:01.744611 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-508652cd-1085-4dd8-97b5-13f8017a6c4b admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:01.745035 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-508652cd-1085-4dd8-97b5-13f8017a6c4b admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:01.765522 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-508652cd-1085-4dd8-97b5-13f8017a6c4b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.086622 Jun 15 14:48:01.766091 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jun 15 14:48:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:13.109417 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:13.110961 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Jun 15 14:48:13.111351 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:13.271025 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell0:SELECT=4 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:13.275278 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell1:SELECT=4 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:13.275278 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=8 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:13.323099 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-2e685ef5-e84d-4e27-8d7f-4c219d857f1f admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:13.324355 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:13.324355 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 15 14:48:13.325579 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-2e685ef5-e84d-4e27-8d7f-4c219d857f1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.326022 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-2e685ef5-e84d-4e27-8d7f-4c219d857f1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.326795 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-2e685ef5-e84d-4e27-8d7f-4c219d857f1f admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:13.327219 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-2e685ef5-e84d-4e27-8d7f-4c219d857f1f admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:13.353418 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-2e685ef5-e84d-4e27-8d7f-4c219d857f1f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087334 Jun 15 14:48:13.353996 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jun 15 14:48:13 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:48:14.257867 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:14.258777 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-1030922c-a1ec-4e80-91fd-97e3031f211b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 15 14:48:14.258777 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Jun 15 14:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:14.459656 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-7cfc09b5-b6df-4951-bdd2-80fea38d9ff1 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:14.461012 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:14.461012 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 15 14:48:14.462182 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-7cfc09b5-b6df-4951-bdd2-80fea38d9ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.462666 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-7cfc09b5-b6df-4951-bdd2-80fea38d9ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.463442 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-7cfc09b5-b6df-4951-bdd2-80fea38d9ff1 admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:48:14.463864 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-7cfc09b5-b6df-4951-bdd2-80fea38d9ff1 admin admin] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:48:14.486789 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-7cfc09b5-b6df-4951-bdd2-80fea38d9ff1 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085880 Jun 15 14:48:14.487342 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Jun 15 14:48:14 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:13.995639 dv-cinder-787296-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 14:49:13.996265 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: Wed Jun 15 14:49:13 2022 - graceful shutdown triggered... Jun 15 14:49:13.996701 dv-cinder-787296-10-iscsi devstack@n-api.service[110222]: Gracefully killing worker 1 (pid: 110222)... Jun 15 14:49:13.997063 dv-cinder-787296-10-iscsi devstack@n-api.service[110223]: Gracefully killing worker 2 (pid: 110223)... Jun 15 14:49:14.996314 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: worker 1 buried after 1 seconds Jun 15 14:49:14.996314 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: worker 2 buried after 1 seconds Jun 15 14:49:14.996314 dv-cinder-787296-10-iscsi devstack@n-api.service[110221]: goodbye to uWSGI. Jun 15 14:49:14.997973 dv-cinder-787296-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 14:49:14.998535 dv-cinder-787296-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 14:49:15.001429 dv-cinder-787296-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:49:15.015130 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:49:15 2022] *** Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: nodename: dv-cinder-787296-10-iscsi Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: machine: x86_64 Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: clock source: unix Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: pcre jit disabled Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: detected number of CPU cores: 4 Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: current working directory: / Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: your processes number limit is 47680 Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: your memory page size is 4096 bytes Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: detected max file descriptor number: 2048 Jun 15 14:49:15.017162 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: lock engine: pthread robust mutexes Jun 15 14:49:15.018266 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: thunder lock: enabled Jun 15 14:49:15.018266 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:49:15.018266 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:49:15.065432 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: Python main interpreter initialized at 0x55a8c80149c0 Jun 15 14:49:15.065432 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: python threads support enabled Jun 15 14:49:15.065432 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: your server socket listen backlog is limited to 100 connections Jun 15 14:49:15.065432 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:49:15.065908 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:49:15.065908 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: *** Operational MODE: preforking *** Jun 15 14:49:15.066185 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:49:15.066185 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: spawned uWSGI master process (pid: 124640) Jun 15 14:49:15.066394 dv-cinder-787296-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:49:15.068186 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: spawned uWSGI worker 1 (pid: 124659, cores: 1) Jun 15 14:49:15.068186 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: spawned uWSGI worker 2 (pid: 124660, cores: 1) Jun 15 14:49:15.068186 dv-cinder-787296-10-iscsi devstack@n-api.service[124640]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:49:15.739232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:49:15.747345 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:49:17.037041 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:49:17.037041 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: from cryptography.utils import int_from_bytes Jun 15 14:49:17.038118 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:49:17.038118 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: from cryptography.utils import int_from_bytes Jun 15 14:49:17.057313 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:49:17.057313 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: from cryptography.utils import int_from_bytes Jun 15 14:49:17.058045 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:49:17.058045 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: from cryptography.utils import int_from_bytes Jun 15 14:49:19.515963 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:49:19.516619 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:49:19.516795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:49:19.517173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:49:19.517432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:49:19.517828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.518181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.518478 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.518803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.519139 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.519455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.519781 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.520137 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.520478 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.520745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.521108 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.521439 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-10-iscsi {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.521773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.522090 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.522409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.522756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.523059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.523450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.523772 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.524331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.525112 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.525696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.526181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.526832 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.527163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.527470 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.527811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.528140 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.529130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.529130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.529392 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-10-iscsi {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.529703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.530024 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.530343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.530770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.531087 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.531391 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.531728 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.532044 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.532475 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.532815 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.533145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.533469 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.533798 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.534110 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.534428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.534744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.535072 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.535387 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.535698 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.535952 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.536294 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.536624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.536952 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.537279 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.537531 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.537801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.538132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.538453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.538807 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.539130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.539436 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.539745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.540061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.540407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.540719 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.541031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.541355 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.541673 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.541998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.542314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.542636 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.543048 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.543311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.543751 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.544002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.544435 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.544621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.544947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.545273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.545588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.545900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.546218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.546540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.546885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.547192 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.547447 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.547753 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.548062 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.551884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.553188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.554257 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.554257 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.555324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.555502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.556724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.556724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.556724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.557206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.557206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.558665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.558665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.558665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.558914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.559201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.559510 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.559832 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.560187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.560523 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.560839 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.561164 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.561486 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.561804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.562119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.562449 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.562756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.563069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.563382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.563686 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.563993 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.564331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.564644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.564951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.565257 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.565580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.565909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.566242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.566538 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.566848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.567173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.567518 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.567857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.568232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.568553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.568892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.569229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.569559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.569878 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.570221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.571104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.571436 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.571759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.572165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.572676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.573095 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.573438 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.573760 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.574087 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.574421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.574741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.575080 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.575403 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.575740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.576059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.576450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.576810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.577148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.577460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.577796 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.578112 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.578430 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.578748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.579076 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.579419 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.579860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.580223 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.580546 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.580868 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.581185 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.581501 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.581818 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.582167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.582485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.582806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.583124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.583455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.583788 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.584125 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.584436 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.584755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.585064 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.585377 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.585693 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.586885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.586885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.587293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.587896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.587896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.588321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.588710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.589031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.589355 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.589711 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.590034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.590353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.590665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.590998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.591313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.591621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.592013 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.592331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.592572 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.592958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.593320 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.593516 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.593913 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.594137 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.594501 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.594774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.595215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.595643 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.595821 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.596347 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.596645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.596915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.597155 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.597863 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.597863 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.598514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.598514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.599063 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.599278 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.599464 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.599925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.600179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.600345 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.600715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.601045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.601362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.602296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.602553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.602865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.603221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.603535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.603887 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.604302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.604599 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.604926 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.605356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.605565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.605879 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.606235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.606515 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.607144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.607409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.607754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.608036 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.608314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.608646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.608962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.609290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.609606 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.609893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:49:19.610513 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.610666 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:49:19.610947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.610947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.611239 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:49:19.611399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.611551 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:49:19.611742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.611930 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:49:19.612903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.613074 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.613305 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.613305 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.613874 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.614033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.614033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.614310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.614455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.614620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.615066 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.615222 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.615368 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.615639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.615804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.615804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.616123 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.616286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.616286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.616572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.616771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.616933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.617111 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.617111 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.617433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.617584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.617738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.618036 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.618036 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.618435 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-10-iscsi {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.618582 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.618582 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.618871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.619035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.619035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.619329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.619483 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.619629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.619824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.619824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.620175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.620336 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.620547 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.620809 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.620809 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.621224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.621388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.621388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.621709 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.621857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.622002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.622198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.622358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.622524 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.622775 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.623145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.623305 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.623466 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.623631 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.624051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.624236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.624236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.624584 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.624749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.624896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.625067 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.625323 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.625482 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.625656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.625903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.626053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.626206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.626369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.626514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.626672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.627039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.627200 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.627346 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.627579 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.627740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.628126 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.628317 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-10-iscsi {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.628567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.628717 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.628860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.629027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.629357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.629529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.629684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.629838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.629992 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.630153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.630454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.630611 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.630789 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.631071 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.631259 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.631426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.631668 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.631883 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.632047 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.632307 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.632482 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.632635 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.633007 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.633178 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.633469 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.633618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.633773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.634219 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.634364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.634668 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.634827 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.634987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.635317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.635491 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.635664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.635989 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.636118 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.636354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.636877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.636981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.637274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.637473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.637651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.638185 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.639870 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.640023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.640023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.640731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.640816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.640816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.640984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.641070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.641154 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.641235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.641332 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.641421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.641421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.641562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.641643 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.641723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.641810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.641905 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.641992 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.641992 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.642170 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.642170 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.642348 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.642442 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.642529 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.642627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.642721 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.642839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.643018 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.643184 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.643351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.643636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.643793 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.643948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.644171 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.644448 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.644610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.644764 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.644947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.645113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.645270 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.645413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.645675 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.645834 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.645976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.646213 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.646380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.646533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.646685 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.646828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.646978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.647121 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.647270 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.647422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.647564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.647706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.647854 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.647998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.648169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.649024 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.649175 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.649328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.649477 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.649621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.649763 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.649763 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.650047 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.650188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.650188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.650465 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.650614 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.650767 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.650922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.651073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.651215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.651355 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.651540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.651705 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.652720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.652923 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.653073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.653231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.653391 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.653535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.653535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.653990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.654135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.654287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.654460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.654778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.654778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.655074 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.655218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.655361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.655513 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.655676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.655936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.656122 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.656396 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.656599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.656599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.656969 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.657192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.657395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.657590 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.657815 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.658020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.658218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.658406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.658590 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.658786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.659234 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.659434 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.659625 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.659772 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.659923 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.660104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.660299 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.660518 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.660755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.660755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.661116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.661315 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.661544 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.661746 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.662071 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.662071 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.662456 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.662643 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.662829 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.662829 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.663228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.663228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.663610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.663610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.664773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.665102 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.665339 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.665540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.665736 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.665987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.666291 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.666593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.666812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.666996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.667199 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.667369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.667549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.667780 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.667993 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.668231 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.668474 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.668669 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.668927 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.669107 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.669404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.669593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.669823 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.669979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.670124 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.670277 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.670439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.670582 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.670582 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.670852 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.671100 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.671419 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.671695 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.671941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.672197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.672350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.672502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.672654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.672804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.672964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.673109 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.673109 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.673387 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.673632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.673792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.673943 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.674104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.674393 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.674630 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.674843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.674999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.675257 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.675419 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:49:19.675564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.675716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.675860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.676010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.676184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.676433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.676605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.676832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.676979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.677130 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.677296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.677453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.677603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.677756 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.677900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.678057 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.678216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.678369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.678522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.678673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.678816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.678957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.679105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.679256 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.679256 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.679785 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.679931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.680074 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.680335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.680479 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.680635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.680786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.680955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.681132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.681298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.681434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.681591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.681723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.681884 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.682035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.682179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.682328 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.682474 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.682616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.682744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.682880 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683290 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683548 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683639 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683780 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.683951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.684145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.684278 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.684415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.684566 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.684696 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.684828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.684973 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685114 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685239 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685552 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685693 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.685960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.686221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.686365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.686510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.686674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.686817 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.686992 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.687187 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.687347 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.687480 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.687616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.687773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.687907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.688035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.688245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.688409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.688549 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.688695 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.688841 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.688983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.689122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.689262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.689385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.689515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.689656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.689792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.689955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.690094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.690239 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.690375 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.690533 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.690710 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.690865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.690992 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691385 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691550 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691761 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.691950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692353 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.692915 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693111 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693276 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693367 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693459 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693545 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693802 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693895 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.693969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694047 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694446 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694754 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.694901 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.695018 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.695113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.695727 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.695727 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.695887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696507 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696724 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.696957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697086 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697155 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697225 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697301 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697385 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697457 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697602 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697679 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697827 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.697968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698360 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698615 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.698941 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.699111 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.699247 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.699426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.699574 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.699748 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.699891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.700064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.700262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.700403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.700588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.700725 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.700914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.701068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.701194 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.701315 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.701505 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.701617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.701811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.701930 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.702117 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.702243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.702423 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.702556 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.702778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.702990 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.703140 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.703294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.703437 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.703592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.703742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.703892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.704032 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.704238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.704387 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.704545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.704709 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.704866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.705028 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.705202 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.705369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.705522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.705685 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.705841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.706496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.706684 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.706852 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.707002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.707150 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.707298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.707446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.707604 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.707764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.707910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.708061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.708545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.708712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.708860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.709104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.709255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.709394 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.709527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.709672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.709672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.710220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.710220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.710512 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.710657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.710841 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.711590 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.711737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.711884 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.712043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.712215 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.712351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.712529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.712679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.712840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.712994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.713133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.713268 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.713443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.713592 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.713742 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.713903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.714064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.714241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.714406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.714562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.714720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.714857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.715008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.715179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.715328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.715476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.715638 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.715798 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.715959 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.716190 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.716361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.716520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.716681 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.716833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.717202 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.717371 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.717535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.717683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.717830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.717966 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.718103 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.718285 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.718676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.718835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.718981 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.719124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.719283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.719427 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.719577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.719577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.719849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.720005 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.720465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.720582 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.720706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.720828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.720991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721550 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721550 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721781 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721874 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.721958 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.722041 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.722133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.722245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.722407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.722568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.722718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.722871 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723021 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723172 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723308 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723611 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723888 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.723991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724078 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724172 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724244 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724753 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.724903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.725015 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.725186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.725280 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.725496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.725600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.725811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.725904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.726130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.726231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.726482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.726686 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.726986 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.727151 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.727290 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.727425 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.727561 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.727698 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.727844 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.727966 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.728136 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.728720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.728720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729028 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.729800 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.730065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.730216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.730391 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.730497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.730711 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.730824 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.731034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.731138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.731347 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.731601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.731714 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.731920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.732136 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.732314 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.732451 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.732607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.732704 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.732935 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.733038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.733256 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.733516 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.733696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.733871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.734034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.734193 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.734344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.734493 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.734656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.734813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.734963 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.735121 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.735279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.735429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.735591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.735741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.735901 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.736051 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.736279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.736446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.736627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.736824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.737036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.737036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.737515 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.737729 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.737729 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.738362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.738647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.738897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.739394 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.739650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.739907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.740200 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.740445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.740946 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.741193 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.741356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.741530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.741696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.741855 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.742019 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.742240 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.742397 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.742558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.742785 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.743219 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.743433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.743621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.743825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.744035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.744309 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.744526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.744738 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.744943 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.745155 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.745372 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.745542 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.745769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.745769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.746165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.746165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.746581 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.746780 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.747008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.747202 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.747416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.747593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.747754 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.747913 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.748074 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.748254 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.748535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.748704 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.748856 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.749044 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.749209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.749380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.749624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.749624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.750003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.750156 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.750352 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.750555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.750789 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.751176 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.751384 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.751539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.751689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.751689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.751984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.752175 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.752361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.752521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.752678 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.752830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.752988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.752988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.753372 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.753530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.753679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.753838 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.754002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.754161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.754311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.754311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.754612 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.754762 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.754921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.755079 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.755229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.755385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.755542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.755691 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.755853 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.756005 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.756204 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.756373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.756534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.756534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.756835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.756988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.757144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.757302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.757458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.757622 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.758620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.758873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.759037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.759201 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.759363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.759527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.759712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.759872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.760029 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.760231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.760398 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.760562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.760720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.760871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.761020 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.761338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.761767 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.761931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.762080 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.762343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.762515 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.762667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.762831 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.762982 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.763138 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.763298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.763535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.763535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.763836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.763995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.764182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.764350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.764510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.764660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.764899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.765051 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.765226 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.765382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.765533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.765533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.765828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.766023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.766201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.766361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.766513 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.766700 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.766856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767014 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767164 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.767918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768224 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768313 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768387 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768571 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768753 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768842 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.768932 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769013 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769093 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769327 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769578 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769678 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.769773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770585 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770679 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.770935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771111 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771261 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771751 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771751 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.771928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772258 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772353 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772441 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772627 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.772992 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.773079 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.773165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.773165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.773372 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774615 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774695 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.774927 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775000 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775071 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775227 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775380 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775459 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775538 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.775831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.776046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.776201 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.776393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.776542 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.776737 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.776837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.777144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.777337 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.777585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.777716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.777841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.777968 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.778082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.778178 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.778292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.778386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.778608 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.778719 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.779004 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.779099 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.779332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.779416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.779644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.779756 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.779971 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.780396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.780396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.780581 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.780678 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.780766 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.780927 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.781023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.781253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.781392 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.781560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.781681 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.781876 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.782196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.782349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.782512 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.782718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.782875 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.783031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.783154 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.783364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.783475 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.783735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.783838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.784043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.784165 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.784431 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.784542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.784708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.785031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.785125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.785351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.785460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.785671 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.785885 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.786005 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.786254 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.786350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.786618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.786776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.786938 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.787221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.787316 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.787572 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.787720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.787873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.788228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.788338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.788559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.788664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.788890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.789168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.789262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.789547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.789958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.790070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.790228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.790487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.790584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.790803 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.790887 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.791201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.791297 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.791522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.791667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.791999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.792242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.792389 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.792570 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:49:19.792944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.793461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.794002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.794482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.794899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.795356 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.795831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.796285 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.797114 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.797295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.797598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.798328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.798634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.799127 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.799466 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.799808 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.800181 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.800589 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.800835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.801596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.801596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.801856 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.802104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.802422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.802745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.803068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.803390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.803714 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.804022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.804383 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.804802 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.805228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.805557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.805897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.806225 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.806542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.806876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.807195 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.807511 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.807829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.808163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.808520 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.808829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.809158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.809498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.809841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.810158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.810502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.810831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.811156 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.811484 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.811821 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.812155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.812472 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.812791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.813105 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.813418 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.813730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.814047 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.814362 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.814698 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.814990 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.815321 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.815633 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.815962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.816306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.816622 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.816937 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.817249 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.817779 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.817979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.818245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.818572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.818901 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.819241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.819556 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.819884 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.820792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.821089 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.821410 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.821847 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.822184 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.822514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.822835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.823153 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.823479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.823803 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.824161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.824736 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.825077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.825401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.825724 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.826044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.826366 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.826689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.827008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.827325 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.827648 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.827966 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.828332 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.828666 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.829002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.829455 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.829791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.830117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.830436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.830763 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.831128 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.831458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.831771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.832116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.832437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.832761 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.833081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.833401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.833723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.834042 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.834361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.834681 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.835000 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.835320 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.835650 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.836736 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.837137 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.837692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.838072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.838404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.838965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.839289 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.839634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.839972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.840335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.840656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.840986 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.841321 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.841639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.841951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.842270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.842586 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.842900 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.843228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.843546 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.843855 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.844206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.844525 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.845068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.845426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.845748 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.846081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.846413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.846737 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.847081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.847385 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.847704 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.848016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.848379 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.848701 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.849014 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.849327 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.849715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.850032 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.850346 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.850665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.850979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.851319 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.851756 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.853437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.853437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.853437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.853911 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.854046 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.854529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.855062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.855599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.856045 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.856510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.856759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.857059 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.857252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO dbcounter [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Registered counter for database nova_api Jun 15 14:49:19.857496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.857833 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.858201 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.858545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.858944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.859163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.859504 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.859822 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.860176 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.860497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.860825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.861186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.861654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.862083 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.862497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.862743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.863089 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.863461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.863856 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.864477 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.864899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.865236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.865631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.865955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.866422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.866753 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.867154 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.867439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.867765 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.868124 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.868434 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.868754 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.869068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.869389 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.869706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.870033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.870391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.870867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.871441 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.871989 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.872599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.873307 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.873735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.874322 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.874774 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.875112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.875468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.875824 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.876138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.876575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.876902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.877254 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.877574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.877854 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_db.sqlalchemy.engines [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:19.878023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.878218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.878554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.878876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.879211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.879536 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.879861 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.880244 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.880629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.880921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.881238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.881552 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.881871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.882191 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.882522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.883487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.883809 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.884145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.884651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.884956 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.885282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.885592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.885857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writer thread running {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:19.885971 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.886205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.886788 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.887098 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.887411 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.887720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.888036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.888371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.888687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.888996 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.889306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.889615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.889930 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.890240 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.890585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.890934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.891255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.891588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.891907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.892260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.892577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.892907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.893238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.893566 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.893886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.894230 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.894542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.894862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.895181 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.895510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.895822 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.896163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.896498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.896832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.897148 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.897487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.897811 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.898139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.899483 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.899821 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.900191 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.900521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.900840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.901164 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.901487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.901810 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.902137 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.902464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.902800 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.903135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.903454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.903837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.906075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:49:19.908376 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:49:19.944341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.context [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62f88910-6aa4-41b0-a16b-3521d73e0cca(cell1) {{(pid=124660) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:49:19.949374 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:19.950980 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:19.951776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:19.953788 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:19.955808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO dbcounter [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Registered counter for database nova_cell0 Jun 15 14:49:19.960024 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO dbcounter [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Registered counter for database nova_cell1 Jun 15 14:49:19.969965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_db.sqlalchemy.engines [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:19.970778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_db.sqlalchemy.engines [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:19.975160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Registered counter for database nova_api Jun 15 14:49:19.977810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writer thread running {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:19.979191 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writer thread running {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:19.999160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-433df082-fe1e-4138-b682-569fa83de830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:20.015336 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:20.078068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.context [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62f88910-6aa4-41b0-a16b-3521d73e0cca(cell1) {{(pid=124659) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:49:20.082306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:20.083984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:20.084840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:49:20.087076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:49:20.089215 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Registered counter for database nova_cell0 Jun 15 14:49:20.093230 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Registered counter for database nova_cell1 Jun 15 14:49:20.101108 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-433df082-fe1e-4138-b682-569fa83de830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:20.102667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-433df082-fe1e-4138-b682-569fa83de830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:20.109258 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:20.135262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO dbcounter [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Registered counter for database nova_cell0 Jun 15 14:49:20.145897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_db.sqlalchemy.engines [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:20.147255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writer thread running {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:20.260907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:20.276054 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO dbcounter [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Registered counter for database nova_cell0 Jun 15 14:49:20.284708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_db.sqlalchemy.engines [None req-433df082-fe1e-4138-b682-569fa83de830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:49:20.293569 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writer thread running {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:49:20.532272 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: WARNING keystonemiddleware.auth_token [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:49:20.542930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: WARNING keystonemiddleware.auth_token [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:49:20.644564 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-433df082-fe1e-4138-b682-569fa83de830 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:49:20.653266 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:49:20.932750 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: WARNING keystonemiddleware.auth_token [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:49:20.939051 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: WARNING keystonemiddleware.auth_token [None req-160a43b6-b0bd-48db-8038-d575ff1ea53b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:49:20.944501 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8c80149c0 pid: 124660 (default app) Jun 15 14:49:21.024132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-433df082-fe1e-4138-b682-569fa83de830 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:49:21.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: WARNING keystonemiddleware.auth_token [None req-433df082-fe1e-4138-b682-569fa83de830 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:49:21.036186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a8c80149c0 pid: 124659 (default app) Jun 15 14:50:05.664437 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:05.666007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:05.667008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:05.668256 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:07.519453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-738038302", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "networks": [{"uuid": "1e692349-82b8-452c-a5c2-e59ca89af13d"}]}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:09.102155 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] validate_networks() for [('1e692349-82b8-452c-a5c2-e59ca89af13d', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:50:11.684858 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:50:11.685813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:50:11.685813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:50:11.686216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:50:11.686692 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:50:11.704468 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.704914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.705711 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:11.706179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:11.768458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Getting quotas for project 0e498ac8b52d4a068016e44c094996c1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:11.781541 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Getting quotas for user e95d993b6ed24073bbf1618ab4d1118e and project 0e498ac8b52d4a068016e44c094996c1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:11.807443 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:50:11.810922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:50:12.123647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-73569bb3-f1ff-46c1-bb56-4659728b2066 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.470065 Jun 15 14:50:12.125699 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 6474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:50:12.142012 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:12.145345 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:12.150295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:12.152962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:12.792253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fe8e3471-e7b6-45a1-b921-5b3fe88bb7f9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:12.796598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fe8e3471-e7b6-45a1-b921-5b3fe88bb7f9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:13.885965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fe8e3471-e7b6-45a1-b921-5b3fe88bb7f9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:13.919902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fe8e3471-e7b6-45a1-b921-5b3fe88bb7f9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1214 microversion: 2.1 time: 1.784800 Jun 15 14:50:13.933872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:12 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1214 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:14.960602 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:14.961421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:14.999183 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:14.999646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.000476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:15.000923 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:15.285365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:15.311664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3a3b66e4-dfcf-4274-88e3-1b39db8a40b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1218 microversion: 2.1 time: 0.375110 Jun 15 14:50:15.318943 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:14 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1218 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:16.337185 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:16.338645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:16.356188 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:16.357414 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:16.358692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:16.359508 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:16.845728 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:16.868668 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9cb8c8af-de49-45ee-946e-3f9a4c31f6d0 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1218 microversion: 2.1 time: 0.537138 Jun 15 14:50:16.870794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:16 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1218 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:17.889060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:17.890304 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:17.899099 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:17.901867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:17.902736 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:17.904552 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:18.234304 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:18.255852 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-af759fd3-be64-4ffe-8aee-3a6249ff5f7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1218 microversion: 2.1 time: 0.370461 Jun 15 14:50:18.260434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:17 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1218 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:18.859244 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-df75ce30-be04-472d-aea2-ff50baaac7da tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'create', calling method: .version_select at 0x7fb8aa1d7310>, body: {"keypair": {"name": "tempest-keypair-1857062980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBwnFp5fB7OAb67zvUHgSa2qgZiKKPJNnBGfbwYoLPDPI7SFwUz49B2/ldn54/wdFx33kRwiatv08OqhVMqOEj7/InNLT7xm1nKybieCkh2eTIYZjbOL2l7XuxdMma1Jw=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:19.073169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-df75ce30-be04-472d-aea2-ff50baaac7da tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:19.103599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-df75ce30-be04-472d-aea2-ff50baaac7da tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for user 0650eb65117a4e27908c4355bfc46c3b and project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:19.274186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-df75ce30-be04-472d-aea2-ff50baaac7da tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.015811 Jun 15 14:50:19.274617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 3/6] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 14:50:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:19.292920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:19.295409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:19.320431 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:19.324372 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:19.327411 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:19.328925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:19.507677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:19.517708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a10c3ce0-603d-4ace-9ec2-a71deed214b9 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1218 microversion: 2.1 time: 0.233366 Jun 15 14:50:19.518334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:19 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:20.555180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:20.559638 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:20.570244 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:20.571303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:20.572902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:20.573886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:20.872768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:20.880850 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4215e879-bab7-42c0-99da-9831505426df tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1218 microversion: 2.1 time: 0.348718 Jun 15 14:50:20.893409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:20 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1218 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:21.741567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:21.794977 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:21.900995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:21.901812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:21.937096 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.941288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:21.955725 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:21.956572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:22.108519 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:22.121377 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-827e0491-4164-47a3-ad98-4053f1294911 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1266 microversion: 2.1 time: 0.226336 Jun 15 14:50:22.122758 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:21 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:22.667162 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-801559794", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:22.829289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] validate_networks() for [('1a1346b8-6a67-4edd-802a-fc2458e6df62', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:50:23.142041 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:23.142916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:23.166120 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:23.166866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:23.168280 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:23.169135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:23.622542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:23.671212 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-85972435-3402-4f8c-9950-f3db0e634d0a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1284 microversion: 2.1 time: 0.534405 Jun 15 14:50:23.681061 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:23 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1284 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:24.180434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:50:24.181012 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:50:24.181319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:50:24.181735 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:50:24.182161 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:50:24.191744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.193338 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.194949 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.195721 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.220080 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for project b356eba3587e481aa04f99bcb2194b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:24.225029 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for user ee9df934d1cd461abbf9c3cd90a8fdda and project b356eba3587e481aa04f99bcb2194b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:24.265724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:50:24.276070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:50:24.510184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0cac5291-dcbd-45e2-9c42-224f28c4bbcb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.244731 Jun 15 14:50:24.513240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 5/11] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:50:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:50:24.529223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-47b67c63-4421-4a91-b4cd-250430d22279 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:24.530234 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-47b67c63-4421-4a91-b4cd-250430d22279 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:24.704334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47b67c63-4421-4a91-b4cd-250430d22279 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:24.712684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:24.721417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:24.766537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-47b67c63-4421-4a91-b4cd-250430d22279 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1221 microversion: 2.1 time: 0.214993 Jun 15 14:50:24.770155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:24 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:24.805009 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.807763 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:24.810290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:24.810290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:25.022985 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:25.036983 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c279ac6f-e45c-4fc9-ba13-20764343c70b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1284 microversion: 2.1 time: 0.340666 Jun 15 14:50:25.052624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:24 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1284 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:25.269064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-963283725", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:25.450247 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] validate_networks() for [('1a1346b8-6a67-4edd-802a-fc2458e6df62', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:50:25.858999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-109912150", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db0cdacf-17d9-4e64-93e8-a444d0282468"}], "security_groups": [{"name": "tempest-securitygroup--1952060347"}], "key_name": "tempest-keypair-1857062980", "user_data": "}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:26.142988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] validate_networks() for [('db0cdacf-17d9-4e64-93e8-a444d0282468', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:50:27.338959 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:50:27.340276 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:50:27.340947 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:50:27.341653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:50:27.342275 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:50:27.356797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.357655 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.358812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.359411 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.426824 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for project b356eba3587e481aa04f99bcb2194b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:27.441273 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for user ee9df934d1cd461abbf9c3cd90a8fdda and project b356eba3587e481aa04f99bcb2194b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:27.480028 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:50:27.485601 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:50:27.701642 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:50:27.702210 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:50:27.703123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:50:27.703605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:50:27.704930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:50:27.721023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.721806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.723699 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.724249 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.735986 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5795c11f-a639-4b6a-8a10-0fd746fe8fd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.479350 Jun 15 14:50:27.737308 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 8/14] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:50:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:50:27.745937 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:27.748427 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:27.770180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.771543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.773089 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:27.774009 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:27.796208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:50:27.820018 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for user 0650eb65117a4e27908c4355bfc46c3b and project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:50:27.840922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:50:27.845021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:50:27.951589 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:27.959893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aa59938f-b08f-44de-9273-0bc760181a0b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1272 microversion: 2.1 time: 0.220769 Jun 15 14:50:27.969250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 9/15] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:27 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:27.975936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5de6331f-dd2c-4bb9-83d6-f3665c7f31fa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:27.976691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5de6331f-dd2c-4bb9-83d6-f3665c7f31fa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:28.042587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d76531f8-fdc9-44e8-b750-6ac7e6c0a6c3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.191295 Jun 15 14:50:28.049382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 7/16] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:50:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:50:28.061068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-aa5bde11-8b0d-4032-966a-cfddcfbd88ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:28.061068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-aa5bde11-8b0d-4032-966a-cfddcfbd88ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:28.076823 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5de6331f-dd2c-4bb9-83d6-f3665c7f31fa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:28.090384 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5de6331f-dd2c-4bb9-83d6-f3665c7f31fa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1221 microversion: 2.1 time: 0.117390 Jun 15 14:50:28.099969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:27 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:28.170344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-aa5bde11-8b0d-4032-966a-cfddcfbd88ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:28.202716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-aa5bde11-8b0d-4032-966a-cfddcfbd88ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1237 microversion: 2.1 time: 0.139705 Jun 15 14:50:28.202716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 8/18] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:28 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:28.983233 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:28.983233 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:28.986095 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.986717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:28.987497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:28.987941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.112011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:29.113287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:29.139905 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.141178 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.141972 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:29.142836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:29.195614 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.208001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5395e010-f6e6-4eb5-96e8-4431679a9be6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.232592 Jun 15 14:50:29.221948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:28 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:29.228562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5ba2c14a-4c25-49e2-ab8a-3df3a47798a7 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:29.229266 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5ba2c14a-4c25-49e2-ab8a-3df3a47798a7 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:29.258794 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.271583 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8f4727c1-f297-4b5a-a2cb-d27704b47490 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1225 microversion: 2.1 time: 0.165741 Jun 15 14:50:29.285213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 9/20] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:29 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1225 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:29.291545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5ba2c14a-4c25-49e2-ab8a-3df3a47798a7 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:29.299522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5ba2c14a-4c25-49e2-ab8a-3df3a47798a7 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1237 microversion: 2.1 time: 0.076341 Jun 15 14:50:29.310742 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 12/21] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:29 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:30.230187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:30.231053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:30.239040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.239040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.239040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.239612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.296264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:30.297295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:30.315966 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.316728 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.318174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.319675 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.420476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:30.430380 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec2ebf95-70d6-4db4-a137-a16ea7bc15db tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1225 microversion: 2.1 time: 0.140833 Jun 15 14:50:30.430937 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:30 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:30.436396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:30.437024 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:30.445485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.446159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.447096 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:30.447591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:30.464897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:30.473059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8eaf7f9f-08d9-4903-b87b-b9e738dd0f91 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.246827 Jun 15 14:50:30.473769 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 10/23] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:30 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:30.516731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:30.528314 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b19d1057-39ab-4e8e-a7a6-0313cd672017 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1241 microversion: 2.1 time: 0.095471 Jun 15 14:50:30.529848 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 14/24] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:30 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:31.448361 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:31.448826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:31.454875 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.455322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.456119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.456564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.494753 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:31.501780 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:31.510720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.511522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.512404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.512941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.533788 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:31.542924 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-387c7e17-aef9-45fa-ae42-d545f32116ed tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1225 microversion: 2.1 time: 0.099399 Jun 15 14:50:31.543817 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 11/25] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:31 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:31.548425 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:31.549042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:31.556273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.556958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.557745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:31.558215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:31.636507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:31.644756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3fe5f0b3-1a08-48df-9472-f9527252db1e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1241 microversion: 2.1 time: 0.099894 Jun 15 14:50:31.645538 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:31 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:31.741120 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:31.749489 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2e14e24d-024e-412a-992f-91bfd79a9e95 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.260155 Jun 15 14:50:31.750092 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:31 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:32.569255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:32.570038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.587697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.588173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.588965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.589402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.665672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:32.668057 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:32.668926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.676015 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.676740 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.677546 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.678011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.691873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8f5f9840-493f-4a92-ab07-bbb842d4c7d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1225 microversion: 2.1 time: 0.120947 Jun 15 14:50:32.692544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 13/28] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:32 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:32.770159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:32.770791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:32.779800 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:32.782540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.783363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.784208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:32.784922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:32.800922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f88b199d-0a77-4c66-af61-3989f388066d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1241 microversion: 2.1 time: 0.136883 Jun 15 14:50:32.801836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:32 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:33.006270 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.018553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3b411619-036c-400a-8b63-83dde4c72593 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.253430 Jun 15 14:50:33.020198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 14/30] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:32 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:33.714418 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:33.716478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:33.726137 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.727251 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.728311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.729786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.831465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:33.832974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:33.845773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.847152 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.848955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:33.850056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:33.916768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:33.931916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b01dd92e-ecdd-4c5b-82a6-86f3906e5b43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1225 microversion: 2.1 time: 0.226185 Jun 15 14:50:33.938216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 17/31] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:33 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1225 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:34.003417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:34.017070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bbb9749d-8b0a-47e8-a528-a6860b865164 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1241 microversion: 2.1 time: 0.195216 Jun 15 14:50:34.017070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 15/32] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:33 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:34.039642 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:34.043133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:34.055562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.056831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.058555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.059599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.551716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:34.564939 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f39a6cc6-a0dd-4fc7-a8ea-d7cf7eb99388 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.530196 Jun 15 14:50:34.566172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 18/33] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:34 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:34.958385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:34.960650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:34.977196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.978055 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:34.981758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:34.981758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.032978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:35.033455 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:35.046117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.046606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.047456 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.047916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.266160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.268394 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.278591 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-33f970d2-7fec-44d9-9474-8d169a42b691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.326645 Jun 15 14:50:35.285811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 16/34] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:34 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:35.285938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d547fdc9-306c-4d7f-a805-36f61f938046 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1233 microversion: 2.1 time: 0.254617 Jun 15 14:50:35.293535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:35 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1233 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:35.589867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:35.589867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:35.596232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.596687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.597606 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:35.598221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:35.956129 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:35.964241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e5485f2b-fff5-4f48-a179-40e2ae750cf1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.379894 Jun 15 14:50:35.965849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 17/36] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:35 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:36.303059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:36.304548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:36.312536 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:36.313575 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:36.315027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:36.316823 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.317367 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.318159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.323177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.326763 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.328001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.329912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.331721 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.340502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=85 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:36.435053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:36.456358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b5049660-05a5-4f56-84da-128659e05c3d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.156136 Jun 15 14:50:36.464020 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 18/37] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:36 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:36.540648 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:36.556865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-df711be7-28e6-4816-a6b5-29ff5af781b9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.261669 Jun 15 14:50:36.558323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 20/38] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:36 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:36.678568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-e53325ce-de48-4272-8a59-6964547b68e2 req-b1207d3a-9f44-4121-bb08-fa3f8a8cb16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6aca7e8-506a-4eb2-bcc3-601589cff5b5", "tag": "7b71bdf0-f5cd-48fa-82ed-70c693a442c3"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:36.699049 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e53325ce-de48-4272-8a59-6964547b68e2 req-b1207d3a-9f44-4121-bb08-fa3f8a8cb16b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.699496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e53325ce-de48-4272-8a59-6964547b68e2 req-b1207d3a-9f44-4121-bb08-fa3f8a8cb16b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.723664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-e53325ce-de48-4272-8a59-6964547b68e2 req-b1207d3a-9f44-4121-bb08-fa3f8a8cb16b service nova] Creating event network-changed:7b71bdf0-f5cd-48fa-82ed-70c693a442c3 for instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 on hv-cinder-78729 Jun 15 14:50:36.724195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e53325ce-de48-4272-8a59-6964547b68e2 req-b1207d3a-9f44-4121-bb08-fa3f8a8cb16b service nova] Acquired lock "compute-rpcapi-router" {{(pid=124660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:50:36.725906 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5d154c57-629b-45d0-ace3-07a5c97fe51d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.726899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5d154c57-629b-45d0-ace3-07a5c97fe51d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.727697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5d154c57-629b-45d0-ace3-07a5c97fe51d None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.728169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5d154c57-629b-45d0-ace3-07a5c97fe51d None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.743748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.compute.rpcapi [None req-5d154c57-629b-45d0-ace3-07a5c97fe51d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:50:36.745357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5d154c57-629b-45d0-ace3-07a5c97fe51d None None] Releasing lock "compute-rpcapi-router" {{(pid=124660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:50:36.775109 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5d154c57-629b-45d0-ace3-07a5c97fe51d None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194149 Jun 15 14:50:36.775806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 19/39] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:36.981947 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:36.982846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:36.991734 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.995677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:36.995677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:36.995677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.261704 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.288948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-274b2a94-8e0d-4a2a-a843-1831bc6d0f06 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.308358 Jun 15 14:50:37.289566 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:36 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:37.488662 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:37.489538 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:37.501651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.502125 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.503039 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.503361 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.704337 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:37.704337 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:37.706708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.706708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-43cf5217-8769-4db8-b916-314584c24d9e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.135985 Jun 15 14:50:37.706903 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:37.706990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 20/41] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:37 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:37.707077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.707077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.707077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:37.707077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:37.715231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:37.726055 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-225abce0-1d26-4743-bdd3-7fdfe0a6e4d2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.135961 Jun 15 14:50:37.727058 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:37 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:38.311590 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:38.312837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:38.315014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=14 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:38.321404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.322470 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.322856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.323464 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.528359 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.541061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-992746ba-83d3-41c9-a41d-7ad2d30b784c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.228884 Jun 15 14:50:38.541061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 21/43] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:38 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:38.638313 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:38.638935 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:38.645685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.646144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.647185 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.647716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.651990 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:38.712488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.719966 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-37ed67d8-beda-474d-9ea8-7ef98023809d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.085679 Jun 15 14:50:38.720559 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:38 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:38.744902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:38.745588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:38.751973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.752458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.753246 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:38.753689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:38.819111 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:38.827281 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4a9f80b8-6fc6-4758-ad50-2249bb20e0d6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.087081 Jun 15 14:50:38.827871 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 22/45] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:38 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:39.554899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:39.555649 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:39.557616 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=18 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:39.562664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.563152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.563931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.564413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.696940 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.704647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-08eb2c28-bb7c-4d89-8712-d512c807dcc5 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.154201 Jun 15 14:50:39.705260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 24/46] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:39 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:39.738819 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:39.739601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:39.746454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.746902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.747701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.748177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.824624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.832302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9c4da5bf-ac98-4401-b57e-760d7c396f99 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.097580 Jun 15 14:50:39.832866 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 23/47] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:39 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:39.845221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:39.845840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:39.852453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.852910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.853683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:39.854150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:39.919436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:39.927086 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-31974bbb-9408-43b9-898e-37e2f8ea339d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.085632 Jun 15 14:50:39.927662 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:39 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:40.722620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:40.723605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:40.730773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.731321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.732148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.732591 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.852762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:40.853738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:40.863242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.863950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.865262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.865922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.900364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:40.909511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1049c6b7-0382-4c7a-8f4b-611727a4fc08 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.191101 Jun 15 14:50:40.910311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 24/49] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:40 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:40.944772 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:40.945505 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:40.949626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:40.959107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-86fdfe93-6bff-4b9e-bce6-87be350ea5ae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.113269 Jun 15 14:50:40.960032 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 26/50] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:40 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:40.960299 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.961077 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:40.962131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:40.962777 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.035867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:41.047930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7d2ec039-2478-476e-9bc9-4bd05b4bfc4b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.106586 Jun 15 14:50:41.048615 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 25/51] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:40 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:41.929286 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:41.931558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:41.938778 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.939318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.940233 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.940873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.980035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:41.980705 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:41.988978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.989487 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:41.992029 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:41.992555 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.094975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.106503 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ace17698-12ea-43e2-8463-4905dd1f66df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.132646 Jun 15 14:50:42.117263 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 26/52] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:41 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:42.123926 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:42.124852 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:42.134264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.134995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.136651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:42.137672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:42.161374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.176978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5c591d26-bee5-4272-b41b-8f52fdea894d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.252939 Jun 15 14:50:42.178487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 27/53] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:41 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:42.250585 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:42.262936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-41138754-33ef-4c4e-8116-b468a21f8c2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.143970 Jun 15 14:50:42.273487 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 27/54] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:42 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:43.125033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.125591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.131498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.131952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.132835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.133350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.199840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.202013 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.202827 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.209432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.210313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.211270 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.211852 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.212265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-da8a5c80-3fb9-4973-857f-e35d0e33ecc0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.090707 Jun 15 14:50:43.213599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 28/55] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:43 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:43.282758 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:43.283534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:43.289843 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:43.291812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.292533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.293731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:43.294424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:43.383881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.392853 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-faf46138-2953-4c69-bdbe-229c654fa3eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.114107 Jun 15 14:50:43.393427 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 29/56] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:43 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:43.409442 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:43.418617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-428a2856-bb89-4f53-a77c-b897155d2c7d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.223540 Jun 15 14:50:43.419431 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 28/57] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:43 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:44.231206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:44.231730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:44.238073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.238522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.239329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.239773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.305283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.314023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7b698edf-6995-4b02-b939-fbd71e77d3fc tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.087161 Jun 15 14:50:44.314621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 30/58] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:44 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:44.414743 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:44.415782 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:44.422578 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.423036 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.423830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.424321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.436682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:44.437409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:44.443865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.444987 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.446010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:44.446828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:44.502407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.511151 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b26455cb-cbad-417b-9e89-e3a7995bad91 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.103498 Jun 15 14:50:44.511999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:44 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:44.601134 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:44.612806 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6a82c84d-fc38-44ad-bf4c-f783fa2e29c6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.179971 Jun 15 14:50:44.613398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 31/60] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:44 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:45.333935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:45.334598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:45.341430 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.341884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.342954 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.343382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.417908 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.425660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2fba1ee1-c43f-45fa-8741-dfb12adb7b54 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1289 microversion: 2.1 time: 0.095688 Jun 15 14:50:45.426221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 30/61] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:45 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:45.535330 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:45.535330 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:45.542431 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.543163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.544245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.544860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.622165 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.631633 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b1204072-f63c-4976-b81a-f8186f16ea1d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.101071 Jun 15 14:50:45.635452 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:45.635452 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:45.642144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.643283 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.644115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 32/62] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:45 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:45.644521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:45.645102 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:45.874124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:45.885900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d1d13d33-cb04-40a4-af1f-b7255a7598b6 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.258564 Jun 15 14:50:45.887668 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:45 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:46.447326 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:46.447326 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:46.453573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.454097 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.454978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.455481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.535693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:46.543509 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-810364f2-30b2-4405-97ac-f57a79cd53b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1297 microversion: 2.1 time: 0.104222 Jun 15 14:50:46.544273 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 33/64] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:46 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:46.651040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:46.651653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:46.658043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.658498 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.659273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.659714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.726594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:46.734348 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3bf4e39a-5b1b-4cec-bb80-2c631dab189f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.087402 Jun 15 14:50:46.734923 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:46 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:46.905941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:46.906559 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:46.912760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.913776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:46.914601 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:46.915042 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.052503 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.060987 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ee6e3d13-0bd5-4e07-b08c-e05d1a5a8b22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.158771 Jun 15 14:50:47.061570 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 34/66] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:46 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:47.565198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:47.565198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:47.565198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:47.569360 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.569811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.571140 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.571737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.641077 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.648881 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3ce348c2-366f-470e-aeaa-01e4b6c7399d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1297 microversion: 2.1 time: 0.091100 Jun 15 14:50:47.649488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 33/67] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:47 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:47.752641 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:47.753193 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:47.759678 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.761910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.761910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:47.761910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:47.824389 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:47.832163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b086e196-e9cd-42c0-813a-aa5e94ab2e92 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.083484 Jun 15 14:50:47.832745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 35/68] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:47 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:48.078001 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:48.078972 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:48.087331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.087827 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.088795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.089258 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.245476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.248319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a82ebea3-6226-4dc9-b44b-a9aea88750cf tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.174304 Jun 15 14:50:48.248902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:48 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:48.666465 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:48.667080 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:48.673769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.674223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.674999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.675437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.739744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.747746 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-59ee2b7c-9340-4d5f-880c-77b1806868f1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1297 microversion: 2.1 time: 0.085494 Jun 15 14:50:48.748349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 36/70] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:48 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:48.849816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:48.850452 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:48.856875 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.857322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.858085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:48.858523 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:48.861126 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:48.924712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:48.932993 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-85efcbbf-16d6-4cfd-adf6-6012f421f570 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.087064 Jun 15 14:50:48.933560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 35/71] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:48 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:49.265442 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:49.266049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:49.272232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.272676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.273976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.274415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.405359 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:49.415752 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ad57fdb5-d624-4b2d-90b4-98dbcd198d5c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.154266 Jun 15 14:50:49.416630 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 37/72] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:49 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:49.766095 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:49.766716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:49.773096 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.774111 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.775177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.775653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.875343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:49.883913 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-91f661bd-b643-402f-bb75-fe70141de2d1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1297 microversion: 2.1 time: 0.122128 Jun 15 14:50:49.895040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 36/73] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:49 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:49.950783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:49.951967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:49.959540 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.960440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:49.961383 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:49.962165 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.063304 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.073462 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec66a1c3-e358-460f-bf6c-62d9be8dfd9b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1273 microversion: 2.1 time: 0.127331 Jun 15 14:50:50.074264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 38/74] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:49 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:50.433352 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:50.433965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:50.440229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.440909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.441699 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.442153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.652206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:50.661888 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f6d46b9f-e9ab-4030-9b17-8adc97e4f153 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.232447 Jun 15 14:50:50.662900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 37/75] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:50 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:50.901884 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:50.902607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:50.915450 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.915917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:50.919426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:50.919426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.029209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.033627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:51.040787 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5e729171-5cc3-490f-ba70-f4a9fd732897 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1295 microversion: 2.1 time: 0.142828 Jun 15 14:50:51.051604 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 39/76] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:50 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1295 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:51.090896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:51.091521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:51.101338 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.102536 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.103977 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.104826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.187641 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.199069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-170099a2-7d3d-409c-8375-4ded03b8ec38 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1291 microversion: 2.1 time: 0.112170 Jun 15 14:50:51.200425 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 38/77] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:51 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1291 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:51.359334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-77814d6b-ee14-4395-9c34-89a71ae0635e req-0176a4d9-bc0c-476f-9b4f-c6dd526ea41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65023b0-7f40-4b7f-85e5-91006b438f4c", "tag": "a43bc32e-bbcc-488c-a3f5-3300379c6a9c"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:50:51.390521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-77814d6b-ee14-4395-9c34-89a71ae0635e req-0176a4d9-bc0c-476f-9b4f-c6dd526ea41e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.390521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-77814d6b-ee14-4395-9c34-89a71ae0635e req-0176a4d9-bc0c-476f-9b4f-c6dd526ea41e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.432513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-77814d6b-ee14-4395-9c34-89a71ae0635e req-0176a4d9-bc0c-476f-9b4f-c6dd526ea41e service nova] Creating event network-changed:a43bc32e-bbcc-488c-a3f5-3300379c6a9c for instance b65023b0-7f40-4b7f-85e5-91006b438f4c on hv-cinder-78729 Jun 15 14:50:51.433734 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-77814d6b-ee14-4395-9c34-89a71ae0635e req-0176a4d9-bc0c-476f-9b4f-c6dd526ea41e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:50:51.436053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d07cc1ef-061e-4dae-8f5a-3624e63a97f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.437351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d07cc1ef-061e-4dae-8f5a-3624e63a97f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.438854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d07cc1ef-061e-4dae-8f5a-3624e63a97f7 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.439807 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d07cc1ef-061e-4dae-8f5a-3624e63a97f7 None None] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.455375 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.compute.rpcapi [None req-d07cc1ef-061e-4dae-8f5a-3624e63a97f7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:50:51.457532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d07cc1ef-061e-4dae-8f5a-3624e63a97f7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:50:51.486925 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d07cc1ef-061e-4dae-8f5a-3624e63a97f7 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262298 Jun 15 14:50:51.488310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 40/78] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:51.679527 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:51.680460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:51.689552 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.690068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.690874 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:51.691525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:51.862967 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:51.872288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a0b8a7e-9eec-430b-8171-a67429bd4239 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.197099 Jun 15 14:50:51.873070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 39/79] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:51 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:52.059566 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.060300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.068428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.068879 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.069757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.070866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.212746 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:52.219648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.220838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.221539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3dc09fe6-08b1-4d1a-8f8c-da563d2ce6f9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.166341 Jun 15 14:50:52.222424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 41/80] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:52.236977 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.237519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.238759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.239426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.387131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:52.393617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7aca5531-0d8e-46c8-9a33-f764e4d335f0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1333 microversion: 2.1 time: 0.179726 Jun 15 14:50:52.394187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 40/81] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1333 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:52.889634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:52.890275 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:52.896422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.896869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:52.897625 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:52.898054 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.038457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:53.047292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7588ca4f-2c67-49ee-8a7a-ecc70f2e5349 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.161872 Jun 15 14:50:53.047883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 42/82] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:52 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:53.278640 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:53.278640 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:53.278640 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.278640 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.279594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.279594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.402898 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:53.410744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:53.411530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:53.411647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0411651d-8a5c-4ed9-8a9d-8be65f43497f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.176393 Jun 15 14:50:53.412195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 41/83] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:53 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:53.418620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.419076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.419852 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:53.420332 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:53.576719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:53.584451 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-98c46f31-97aa-4275-8c16-3304350d75e5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1333 microversion: 2.1 time: 0.177443 Jun 15 14:50:53.585395 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:53 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1333 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:54.064894 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:54.065511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:54.072234 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.072685 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.073465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.073912 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.213330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.221033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f3abb210-7724-4302-a3bf-d1d9db431aeb tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.160014 Jun 15 14:50:54.221512 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 42/85] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:54 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:54.437374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:54.438290 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:54.445475 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.446090 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.447421 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.448031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.605525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:54.606866 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:54.611922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.614115 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.614658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.615716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:54.616252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:54.620623 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1fd5cc35-7205-43d0-9d3d-3006085a4d4e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.187077 Jun 15 14:50:54.621210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 44/86] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:54 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:54.760465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:54.768675 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-74d1badf-9f64-4b02-90d8-fdcd17d3b66e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1333 microversion: 2.1 time: 0.169621 Jun 15 14:50:54.769255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 43/87] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:54 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1333 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:55.240209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:55.240833 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:55.247516 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.247974 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.248796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.249264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.413551 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:55.428295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c7c0f579-40d4-47fb-9ae3-5aa0146fa715 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.192464 Jun 15 14:50:55.429148 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 45/88] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:55 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:55.642970 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:55.643584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:55.650119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.650613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.651487 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.651936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.787920 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:55.791594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:55.798072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.798534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.799310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:55.800715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:55.846732 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:55.860364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e01f415b-93fd-4300-b1af-ffffcee459b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.221066 Jun 15 14:50:55.861183 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 44/89] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:55 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:55.955165 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:55.963617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2036a42c-cfa7-47e6-957a-94c65ab8c85b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1333 microversion: 2.1 time: 0.180612 Jun 15 14:50:55.964062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 46/90] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:55 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1333 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:56.453816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:56.453816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:56.454950 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.455412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.456228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.456674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.645104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:56.653776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d6112bfc-4c37-4e12-8c46-4c210ff9a44d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.210780 Jun 15 14:50:56.654799 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 45/91] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:56 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:56.878995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:56.879599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:56.888426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.888905 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.891791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.891791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.984518 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:56.985663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:56.996543 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.997360 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:56.998415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:56.999556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:57.061090 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:57.070394 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e6e267f0-9642-44ce-800e-7b55cc2edd1a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.195511 Jun 15 14:50:57.071464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 47/92] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:56 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:57.161701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:57.172244 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e17ffa7b-2641-4e10-b592-d499cd6f517d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1333 microversion: 2.1 time: 0.196220 Jun 15 14:50:57.173229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 46/93] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:56 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1333 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:50:57.671913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:57.672469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:57.678640 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:57.679094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:57.679895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:57.680358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:57.859354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:57.859354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-34665e36-d493-4337-a2e0-97d6053bfe35 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.186759 Jun 15 14:50:57.859354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 48/94] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:57 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:58.090306 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:58.091147 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:58.097782 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.098601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.099399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.099889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.197069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:58.198687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:58.206799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.209407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.209407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.209407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.336996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:58.350544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-88b47083-e7ea-4154-8d54-adf2e557473d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.265376 Jun 15 14:50:58.362790 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 47/95] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:58 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:58.423839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:58.432140 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ebd89cfa-b55b-4a61-97e3-bb82687f095e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.246153 Jun 15 14:50:58.432739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 49/96] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:58 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:58.878874 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:58.880785 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:58.891057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.892069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:58.893497 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:58.895048 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:59.370394 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:59.371178 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:59.385706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:59.389188 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:59.390169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:59.391620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:59.883552 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:50:59.901448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ab655f59-f5b7-4998-9969-2d4ac6b1799e tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 1.030540 Jun 15 14:50:59.904488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 48/97] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:58 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:59.919342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:59.920616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:50:59.952385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:59.954153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:50:59.955562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:50:59.956344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.737287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:00.752759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a4559ff1-5160-4217-9f59-e9fd9856dadf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 1.387062 Jun 15 14:51:00.755252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 50/98] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:59 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:00.832183 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:00.848819 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9c170347-8f57-4a2c-badd-86bd9e13a2f8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.942907 Jun 15 14:51:00.849427 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 49/99] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:50:59 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:00.923110 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:00.923982 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:00.952316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.953439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:00.955026 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:00.955910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:01.167520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-751916f9-7ca0-448a-9621-4db0a31dc3d0 req-e1eacc5f-ca76-4ab2-ac57-417b4b3671f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "408e1d57-c792-4ac6-9112-a83dfc0cab85", "tag": "3bdc7e34-f0cd-4840-88cb-77a1a31e769f"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:01.188932 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-751916f9-7ca0-448a-9621-4db0a31dc3d0 req-e1eacc5f-ca76-4ab2-ac57-417b4b3671f1 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:01.189931 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-751916f9-7ca0-448a-9621-4db0a31dc3d0 req-e1eacc5f-ca76-4ab2-ac57-417b4b3671f1 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:01.228243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-751916f9-7ca0-448a-9621-4db0a31dc3d0 req-e1eacc5f-ca76-4ab2-ac57-417b4b3671f1 service nova] Creating event network-changed:3bdc7e34-f0cd-4840-88cb-77a1a31e769f for instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 on hv-cinder-78729 Jun 15 14:51:01.246072 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-751916f9-7ca0-448a-9621-4db0a31dc3d0 req-e1eacc5f-ca76-4ab2-ac57-417b4b3671f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079037 Jun 15 14:51:01.250021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 50/100] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:01.453024 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:01.813138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:01.831930 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-39247393-f55e-4cb1-89ad-4ff4388471ff tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.914577 Jun 15 14:51:01.832344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 51/101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:00 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:01.845224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:01.850894 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:01.865887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:01.866583 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:01.872036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:01.873047 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.198297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-e00e8a3f-c3be-439f-a8f9-6313d51a824d req-ef20d872-832c-43ed-b8f0-b024beb0bcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6aca7e8-506a-4eb2-bcc3-601589cff5b5", "name": "network-vif-plugged", "status": "completed", "tag": "7b71bdf0-f5cd-48fa-82ed-70c693a442c3"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:02.208401 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e00e8a3f-c3be-439f-a8f9-6313d51a824d req-ef20d872-832c-43ed-b8f0-b024beb0bcc4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.209088 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e00e8a3f-c3be-439f-a8f9-6313d51a824d req-ef20d872-832c-43ed-b8f0-b024beb0bcc4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.243057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-e00e8a3f-c3be-439f-a8f9-6313d51a824d req-ef20d872-832c-43ed-b8f0-b024beb0bcc4 service nova] Creating event network-vif-plugged:7b71bdf0-f5cd-48fa-82ed-70c693a442c3 for instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 on hv-cinder-78729 Jun 15 14:51:02.249816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-e00e8a3f-c3be-439f-a8f9-6313d51a824d req-ef20d872-832c-43ed-b8f0-b024beb0bcc4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.772231 Jun 15 14:51:02.251351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 51/102] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:02.274102 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:02.275423 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:02.283606 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.284290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.286024 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.287096 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.318290 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:02.330914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-796bb9c0-f94e-4ab4-bf6c-935356ad257a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.491149 Jun 15 14:51:02.333498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 52/103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:01 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:02.340365 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-669a8e86-c34a-47d5-aa22-7afbb9faa20b req-e41bb6c3-7885-4231-bfed-b23d654ea2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af1b5d3-7171-4426-b239-bc34951326cf", "tag": "c77b9439-402e-4a93-afeb-ec23f099ae61"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:02.356585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-669a8e86-c34a-47d5-aa22-7afbb9faa20b req-e41bb6c3-7885-4231-bfed-b23d654ea2a7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.357044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-669a8e86-c34a-47d5-aa22-7afbb9faa20b req-e41bb6c3-7885-4231-bfed-b23d654ea2a7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.371691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-669a8e86-c34a-47d5-aa22-7afbb9faa20b req-e41bb6c3-7885-4231-bfed-b23d654ea2a7 service nova] Creating event network-changed:c77b9439-402e-4a93-afeb-ec23f099ae61 for instance 9af1b5d3-7171-4426-b239-bc34951326cf on hv-cinder-78729 Jun 15 14:51:02.389376 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-669a8e86-c34a-47d5-aa22-7afbb9faa20b req-e41bb6c3-7885-4231-bfed-b23d654ea2a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053207 Jun 15 14:51:02.398966 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 53/104] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:02.512124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:02.520332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-87d6d244-f564-481d-bbb9-f6011159bafa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.267712 Jun 15 14:51:02.533656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 52/105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:02 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:02.850005 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:02.850880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:02.859049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.859597 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:02.860592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:02.861182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.033525 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:03.042758 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7b7adb51-1eda-4618-8417-43c0391eea5d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.196807 Jun 15 14:51:03.043144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 54/106] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:02 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:03.350486 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:03.351119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:03.358701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.359410 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.360218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.360660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.365759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:03.503222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:03.511099 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e324775a-69f6-486a-831c-0221bc3ddb65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.164486 Jun 15 14:51:03.511931 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:03 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:03.550885 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:03.551522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:03.558440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.558891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.559757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:03.560143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:03.743541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:03.754906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5e32c54b-8647-4772-9590-b0e3df3f187c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.207603 Jun 15 14:51:03.755769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 55/108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:03 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:04.062892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:04.063472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:04.072022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.072502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.073577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.074013 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.270161 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:04.278901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0827f6e6-e157-412a-8fd7-2ae80d2140b2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.221545 Jun 15 14:51:04.279476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 54/109] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:04 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:04.528885 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:04.529445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:04.535371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.535820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.536619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.537053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.698628 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:04.706576 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-746a534f-e48a-4a4a-98b0-d68db7f39ecf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.181656 Jun 15 14:51:04.707178 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 56/110] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:04 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:04.774469 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:04.775089 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:04.781681 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.782062 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.782846 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:04.783282 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:04.937127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:04.948463 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-df50bfee-70d0-4d0c-82eb-c57cfb434cbb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.174923 Jun 15 14:51:04.949497 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 55/111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:04 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:05.297282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:05.298022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:05.304168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:05.304628 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:05.305474 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:05.305841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:05.325013 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:05.441232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:05.449529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-54f2c58a-cc8d-4a0d-a151-27a0eb054661 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.156233 Jun 15 14:51:05.450092 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:05 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:05.723687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:05.724458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:05.731397 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:05.731846 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:05.732672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:05.733101 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:05.866926 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:05.874680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b64553df-2105-41b3-a6b5-ceec0aa2a662 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.154748 Jun 15 14:51:05.875547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 56/113] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:05 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:05.962907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:05.964415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:05.970603 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:05.971068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:05.971857 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:05.972511 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.127667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:06.135836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-971625cf-d24c-4d7a-96d6-4e6bc41fd72d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.178069 Jun 15 14:51:06.136702 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 58/114] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:05 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:06.466691 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:06.467378 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:06.473847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.474293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.475061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.475493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.627096 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:06.636661 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2757a3c6-9ec0-4afb-a041-77a455f74cba tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.173431 Jun 15 14:51:06.637245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 57/115] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:06 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:06.892135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:06.893119 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:06.899541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.900080 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:06.901206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:06.901646 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:07.052985 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:07.061824 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bddfe46e-2749-41cb-8ab5-38ecf4350292 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.173681 Jun 15 14:51:07.062743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 59/116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:06 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:07.156406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:07.157120 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:07.163665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:07.165060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:07.166034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:07.166482 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:07.315861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:07.324308 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f420093f-9003-491d-aabd-2fe88088e691 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.171956 Jun 15 14:51:07.324892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 58/117] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:07 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:07.654149 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:07.654982 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:07.661204 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:07.663203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:07.663203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:07.663203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:07.807495 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:07.815845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b2e4aedd-c108-4686-a624-4cef9d3979d2 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.165818 Jun 15 14:51:07.816453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 60/118] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:07 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:08.086173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:08.086907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:08.089035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=82 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:08.094008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.094458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.095225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.095654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.244820 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:08.252520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-94e4d118-7e73-4a1b-a95d-225a14f31f5a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.170604 Jun 15 14:51:08.253092 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 59/119] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:08 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:08.342463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:08.343255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:08.349593 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.350119 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.350968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.352258 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.517555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:08.526041 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e50e1645-ab5c-4cc7-9b40-0a4ecf56881d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.187515 Jun 15 14:51:08.526720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 61/120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:08 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:08.837998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:08.838524 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:08.844773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.845219 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.845993 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:08.846419 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:08.998512 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:09.009283 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b6a745eb-dd99-4d55-85f2-93cee7152cab tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.175315 Jun 15 14:51:09.010157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 60/121] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:08 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:09.269851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:09.270496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:09.277428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:09.277871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:09.278635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:09.279066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:09.459294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:09.471407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e84a3e67-4612-44a0-9e13-e3feccd29661 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.205112 Jun 15 14:51:09.471997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 62/122] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:09 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:09.548789 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:09.557619 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:09.577105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:09.577584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:09.581799 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:09.583682 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:09.835985 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:09.843694 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-19008a12-7409-4d15-9731-a11a39069e93 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.303701 Jun 15 14:51:09.844307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 61/123] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:09 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:10.029866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:10.031252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:10.039351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.040158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.041193 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.041717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.455580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:10.465390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4dd08ed8-be0f-431d-a483-6daccbaba42c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.442119 Jun 15 14:51:10.473883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 63/124] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:10 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:10.495257 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:10.496717 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:10.510107 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.512400 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.518831 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.518831 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.850540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:10.866374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:10.867008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:10.869234 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f5b5ffbc-5312-427d-9f12-c4ebd96e7938 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.382423 Jun 15 14:51:10.886557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 62/125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:10 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:10.888156 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.888722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.892457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.892919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:10.979328 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-46fddb2c-7d35-4e41-b9dd-dff808c6549c req-265775b6-a521-475b-a04f-a3010fd53f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65023b0-7f40-4b7f-85e5-91006b438f4c", "name": "network-vif-plugged", "status": "completed", "tag": "a43bc32e-bbcc-488c-a3f5-3300379c6a9c"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:10.994113 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-46fddb2c-7d35-4e41-b9dd-dff808c6549c req-265775b6-a521-475b-a04f-a3010fd53f3d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:10.994563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-46fddb2c-7d35-4e41-b9dd-dff808c6549c req-265775b6-a521-475b-a04f-a3010fd53f3d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:11.007202 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-46fddb2c-7d35-4e41-b9dd-dff808c6549c req-265775b6-a521-475b-a04f-a3010fd53f3d service nova] Creating event network-vif-plugged:a43bc32e-bbcc-488c-a3f5-3300379c6a9c for instance b65023b0-7f40-4b7f-85e5-91006b438f4c on hv-cinder-78729 Jun 15 14:51:11.014652 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-46fddb2c-7d35-4e41-b9dd-dff808c6549c req-265775b6-a521-475b-a04f-a3010fd53f3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046251 Jun 15 14:51:11.015259 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 63/126] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:11.125084 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:11.131303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d899d4ae-e1bb-49e2-a6e0-a6e561999f41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.274085 Jun 15 14:51:11.143564 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 64/127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:10 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:11.514413 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:11.515170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:11.521854 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:11.522307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:11.523250 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:11.523800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:11.765794 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:11.778905 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7a43149c-475b-4e50-b094-6982fe2a3c22 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.269610 Jun 15 14:51:11.780771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 64/128] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:11 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:11.890750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:11.891391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:11.899250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:11.899685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:11.900953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:11.902038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.105448 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:12.127929 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ebd37935-e293-4d7d-b447-1beb00d36aa5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.234400 Jun 15 14:51:12.127929 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 65/129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:11 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:12.155886 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:12.157004 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:12.170897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.172822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.173945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.174833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.625868 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:12.638489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ea5e5ada-116d-456c-b607-9c8796355c83 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.490854 Jun 15 14:51:12.639390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 65/130] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:12 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:12.806634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:12.807274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:12.816681 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.817327 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:12.818774 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:12.818774 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:13.025104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:13.033172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9641dd07-111b-485d-a2f6-ea4e298303f1 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.230536 Jun 15 14:51:13.033751 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 66/131] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:12 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:13.147787 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:13.149003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:13.157189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:13.157833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:13.161745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:13.161745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:13.346479 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:13.355777 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a268f1b2-69e3-48c2-aa0e-ac2fceb44742 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.212266 Jun 15 14:51:13.356861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 66/132] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:13 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:13.660653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:13.661424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:13.669241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:13.669947 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:13.670768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:13.671229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:13.908676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:13.923815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-750aa2ad-8a5e-4d50-a9a8-1138d5ee543d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.266768 Jun 15 14:51:13.925495 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 67/133] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:13 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:14.050199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:14.050916 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:14.057585 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.058026 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:14.058982 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.064481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:14.225758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:14.240269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a9d92933-2524-4999-9331-e29942d6931f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1314 microversion: 2.1 time: 0.190603 Jun 15 14:51:14.240269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 67/134] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:14 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:14.373789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:14.374410 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:14.376324 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=78 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:14.381374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.381854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:14.383359 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.383804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:14.535715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:14.558687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-df6b2aa0-ad14-400e-8fe1-259fd6017ef5 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.188856 Jun 15 14:51:14.559292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 68/135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:14 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:14.941556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:14.942170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:14.950572 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.956684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:14.956684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:14.956684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.124493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:15.133588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0fccc4b1-1d68-4365-bf6b-5760ef468d9d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.194919 Jun 15 14:51:15.140311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 68/136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:14 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:15.262625 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:15.263283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:15.272031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.272834 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.274835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.275449 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.473063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:15.482759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a11ec50e-4794-4aa4-90ad-f1ee1e21f797 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1500 microversion: 2.1 time: 0.225022 Jun 15 14:51:15.483672 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 69/137] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:15 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1500 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:15.577506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:15.578119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:15.584604 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.585049 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.586430 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:15.586871 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:15.817318 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:15.834213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-abab53ac-79c1-4ab8-b5ac-ab21efad8365 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.260009 Jun 15 14:51:15.836607 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 69/138] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:15 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:16.152621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:16.153309 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:16.163030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.164437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.165555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.166325 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.335210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:16.344490 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2e2f1ded-7d03-46b7-805c-b0ac59e8a1a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.197309 Jun 15 14:51:16.345077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 70/139] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:16 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:16.853626 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:16.854242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:16.860827 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.861275 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.862043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:16.862474 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:16.878242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:17.012899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:17.020581 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f3ec309e-b318-483a-b44c-69ddad4b7e23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.171139 Jun 15 14:51:17.021141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 70/140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:16 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:17.364491 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:17.365224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:17.371936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:17.372563 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:17.373334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:17.373789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:17.525687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:17.535533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-50789162-30fb-4e2e-8d1f-1b38742cf81a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.175621 Jun 15 14:51:17.535795 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 71/141] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:17 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:18.038948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:18.039534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:18.046784 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:18.047265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:18.048117 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:18.048566 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:18.199345 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:18.209744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0978a942-db83-4d57-9ffc-375eaef6b112 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.173358 Jun 15 14:51:18.210437 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 71/142] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:18 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:18.553426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:18.554603 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:18.563096 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:18.563664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:18.565159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:18.574579 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:18.762577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:18.770596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-30fa44d6-7db6-4560-aac0-4badfb51f410 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.222262 Jun 15 14:51:18.771401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 72/143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:18 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:19.233925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:19.234859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:19.245722 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:19.246527 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:19.247864 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:19.248827 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:19.430187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:19.438212 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-01876527-fe09-4123-98c8-21e0c1cabfe9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.209435 Jun 15 14:51:19.438870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 72/144] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:19 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:19.851688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:19.851688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:19.851688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:19.851688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:19.852931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:19.852931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:19.933783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:19.946396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7ed5b70d-428b-4e65-965c-acff631ba7b3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.161240 Jun 15 14:51:19.956159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 73/145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:19 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:20.457890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:20.457890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:20.466532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:20.466876 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:20.467693 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:20.468166 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:20.631217 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:20.641379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4694b9ee-74b1-47ed-b337-ca92c710034a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.187885 Jun 15 14:51:20.642520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 73/146] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:20 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:20.974104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:20.974104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:20.982709 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:20.983325 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:20.984791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:20.985932 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:21.009195 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:21.166821 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:21.176765 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8cf79980-c5ae-4d59-84bc-4ca99018494e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.212954 Jun 15 14:51:21.177409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 74/147] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:20 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:21.659275 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:21.660744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:21.667295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:21.667739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:21.668537 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:21.668968 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:21.834337 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:21.842942 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f60574cf-4b4a-42af-9e67-c41ac1574f66 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.187566 Jun 15 14:51:21.843551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 74/148] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:21 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:22.196680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:22.198304 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:22.203352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:22.203801 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:22.204595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:22.205030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:22.350205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:22.358823 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-050cbc28-b233-4818-a14f-7d8941486888 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.166420 Jun 15 14:51:22.359524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 75/149] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:22 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:22.862733 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:22.863933 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:22.872035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:22.872523 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:22.876422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:22.876422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:23.025908 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:23.034590 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d2a2c7b7-496f-48dd-ba38-0dac95807ab0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.175759 Jun 15 14:51:23.036377 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 75/150] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:22 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:23.377002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:23.377816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:23.385143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:23.387875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:23.387875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:23.387875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:23.572686 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:23.581451 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-adcec035-1ebf-41ef-9d9c-2c5900c41542 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.208336 Jun 15 14:51:23.582248 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 76/151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:23 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:24.052985 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:24.053614 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:24.061628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:24.062197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:24.063122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:24.063639 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:24.296869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:24.307022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-adc40220-1b4e-49a5-85ff-7ed76c65b021 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.258497 Jun 15 14:51:24.309391 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 76/152] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:24 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:24.606624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:24.607360 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:24.613463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:24.613916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:24.614901 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:24.616200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:24.815577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:24.831370 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7134ce60-0d37-4666-a01b-9396cc5f5f8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.229324 Jun 15 14:51:24.833478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 77/153] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:24 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:25.333088 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:25.333711 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:25.340826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:25.341341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:25.342307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:25.342888 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:25.505943 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:25.514433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d41bc976-6f44-45c4-b92b-0af3fd9f4b6d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.185412 Jun 15 14:51:25.515417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 77/154] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:25 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:25.849146 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:25.850346 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:25.858277 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:25.858732 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:25.859504 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:25.860137 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.011441 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:26.020264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f79b1b63-485f-42c9-8c9b-1e1a6650368c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.174874 Jun 15 14:51:26.020784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 78/155] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:25 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:26.131781 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-341da46a-413d-44ae-aba4-e875c3b27ae4 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97bbbdeb-b26b-4e56-aedb-e1f2cca1bdaa"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:26.133556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-341da46a-413d-44ae-aba4-e875c3b27ae4 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:26.148541 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-341da46a-413d-44ae-aba4-e875c3b27ae4 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:26.149508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-341da46a-413d-44ae-aba4-e875c3b27ae4 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.152891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-341da46a-413d-44ae-aba4-e875c3b27ae4 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:26.152891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-341da46a-413d-44ae-aba4-e875c3b27ae4 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.532048 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:26.532972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:26.543962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:26.544740 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.545691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:26.546293 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.740016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:26.752102 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-44e99f95-7169-4c46-931b-49d33ca07bae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.223478 Jun 15 14:51:26.756777 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 79/156] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:26 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:26.767998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-c7f2f35e-4f25-4d44-81ad-07d7bc92f4cd req-de2c46be-153b-4ea5-83b6-f17e30e62855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af1b5d3-7171-4426-b239-bc34951326cf", "name": "network-vif-plugged", "status": "completed", "tag": "c77b9439-402e-4a93-afeb-ec23f099ae61"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:26.779288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c7f2f35e-4f25-4d44-81ad-07d7bc92f4cd req-de2c46be-153b-4ea5-83b6-f17e30e62855 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:26.785308 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c7f2f35e-4f25-4d44-81ad-07d7bc92f4cd req-de2c46be-153b-4ea5-83b6-f17e30e62855 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:26.795724 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-c7f2f35e-4f25-4d44-81ad-07d7bc92f4cd req-de2c46be-153b-4ea5-83b6-f17e30e62855 service nova] Creating event network-vif-plugged:c77b9439-402e-4a93-afeb-ec23f099ae61 for instance 9af1b5d3-7171-4426-b239-bc34951326cf on hv-cinder-78729 Jun 15 14:51:26.808574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-c7f2f35e-4f25-4d44-81ad-07d7bc92f4cd req-de2c46be-153b-4ea5-83b6-f17e30e62855 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040389 Jun 15 14:51:26.809550 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 80/157] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:51:27.043516 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:27.045575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:27.054521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:27.055482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:27.056560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:27.057496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:27.267869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:27.295845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6051494d-7e03-4162-ae1c-89a200cf4e9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.258840 Jun 15 14:51:27.298044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 81/158] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:27 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:27.770076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:27.770683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:27.777694 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:27.778143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:27.778916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:27.779354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:27.922439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:27.930460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d4b4e7cf-a351-454c-917f-743280a74d23 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.164317 Jun 15 14:51:27.931016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 82/159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:27 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:28.315676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:28.317234 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:28.325868 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:28.336253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:28.336253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:28.336253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:28.541085 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:28.552620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-165e7fa2-10c4-4b89-9b7f-95e6d9d7b129 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.241588 Jun 15 14:51:28.553262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 83/160] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:28 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:28.834391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-9999b933-8a55-4f50-b9c1-4b93c8e18922 req-d32f789e-cc4d-46ed-a799-60a91f13d460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408e1d57-c792-4ac6-9112-a83dfc0cab85", "name": "network-vif-plugged", "status": "completed", "tag": "3bdc7e34-f0cd-4840-88cb-77a1a31e769f"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:28.843354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-9999b933-8a55-4f50-b9c1-4b93c8e18922 req-d32f789e-cc4d-46ed-a799-60a91f13d460 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:28.844113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-9999b933-8a55-4f50-b9c1-4b93c8e18922 req-d32f789e-cc4d-46ed-a799-60a91f13d460 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:28.857907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-9999b933-8a55-4f50-b9c1-4b93c8e18922 req-d32f789e-cc4d-46ed-a799-60a91f13d460 service nova] Creating event network-vif-plugged:3bdc7e34-f0cd-4840-88cb-77a1a31e769f for instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 on hv-cinder-78729 Jun 15 14:51:28.863474 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-9999b933-8a55-4f50-b9c1-4b93c8e18922 req-d32f789e-cc4d-46ed-a799-60a91f13d460 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Jun 15 14:51:28.865084 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 84/161] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:51:28.949126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:28.949839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:28.956480 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:28.956922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:28.957685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:28.958113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:28.985556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-341da46a-413d-44ae-aba4-e875c3b27ae4 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "POST /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.857564 Jun 15 14:51:28.986551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 78/162] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 14:51:26 2022] POST /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5/os-volume_attachments => generated 194 bytes in 2859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:29.100385 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:29.108257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-85bba9ef-53b7-4268-a9ea-708ce9c894fe tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.163916 Jun 15 14:51:29.108838 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 85/163] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:28 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:29.580157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:29.581298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:29.591549 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:29.592432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:29.593417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:29.594313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:29.783413 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:29.795037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-46acb562-6011-43ec-8473-eafb371ffb74 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.220582 Jun 15 14:51:29.796434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 79/164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:29 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:30.125534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:30.126332 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:30.133787 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:30.133995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:30.134944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:30.135431 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:30.408285 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:30.416175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-427bfa98-5de9-4951-bba0-14ca801b11df tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.294541 Jun 15 14:51:30.417995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 86/165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:30 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:30.813286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:30.813878 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:30.821806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:30.822260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:30.823120 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:30.823535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:30.991041 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:31.000221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4832a0d1-b590-4822-b4eb-44c8b8e5d359 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.191304 Jun 15 14:51:31.000811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 80/166] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:30 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:31.441550 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:31.442270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:31.455540 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:31.456003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:31.456869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:31.457282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:31.751605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:31.762756 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-660f65cc-da82-4f8e-a57b-4cf534d44fd6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1363 microversion: 2.1 time: 0.326917 Jun 15 14:51:31.772972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 87/167] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:31 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:32.020302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:32.020948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:32.028629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.029348 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.030319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.030932 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.182543 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:32.191890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-18e5e99e-91c9-4f9f-a32f-020113a8c29f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.174097 Jun 15 14:51:32.191890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 81/168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:32 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:32.780482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:32.781103 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:32.789143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.790030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.791204 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.791714 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.954335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:32.963636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f30f4211-583d-472f-96ba-799ffb300cb9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1549 microversion: 2.1 time: 0.186889 Jun 15 14:51:32.964578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:32 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:32.983389 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d963cd9b-ed91-4600-8b5c-68dd61ac027b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:32.983891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d963cd9b-ed91-4600-8b5c-68dd61ac027b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:32.992994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d963cd9b-ed91-4600-8b5c-68dd61ac027b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.994154 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d963cd9b-ed91-4600-8b5c-68dd61ac027b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:32.994965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d963cd9b-ed91-4600-8b5c-68dd61ac027b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:32.995454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d963cd9b-ed91-4600-8b5c-68dd61ac027b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:33.096193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d963cd9b-ed91-4600-8b5c-68dd61ac027b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103840 Jun 15 14:51:33.096193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 82/170] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 14:51:32 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:33.209348 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:33.210172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:33.218091 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:33.218693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:33.219584 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:33.220169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:33.370657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:33.381427 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-43ec0c5f-43cd-47b9-b080-65eb9f4c735b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.176691 Jun 15 14:51:33.383880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 89/171] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:33 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:34.401560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:34.402427 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:34.409646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:34.410102 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:34.410889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:34.411325 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:34.643249 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:34.651857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d9c6e6ef-4140-4ea0-80ea-f97563c3175f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.256212 Jun 15 14:51:34.653015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 83/172] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:34 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:34.872578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-bf1b4f2d-dd43-4aeb-8a17-46c5007af3d7 req-1746e5dc-62e3-452a-aaab-3a785421599b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af1b5d3-7171-4426-b239-bc34951326cf", "tag": "c77b9439-402e-4a93-afeb-ec23f099ae61"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:34.874904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-bf1b4f2d-dd43-4aeb-8a17-46c5007af3d7 req-1746e5dc-62e3-452a-aaab-3a785421599b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:34.875364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-bf1b4f2d-dd43-4aeb-8a17-46c5007af3d7 req-1746e5dc-62e3-452a-aaab-3a785421599b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:34.889887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-bf1b4f2d-dd43-4aeb-8a17-46c5007af3d7 req-1746e5dc-62e3-452a-aaab-3a785421599b service nova] Creating event network-changed:c77b9439-402e-4a93-afeb-ec23f099ae61 for instance 9af1b5d3-7171-4426-b239-bc34951326cf on hv-cinder-78729 Jun 15 14:51:34.895282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-bf1b4f2d-dd43-4aeb-8a17-46c5007af3d7 req-1746e5dc-62e3-452a-aaab-3a785421599b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034839 Jun 15 14:51:34.895886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 90/173] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:51:35.674987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:35.675613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:35.685095 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:35.686984 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:35.687833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:35.688351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:35.987592 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:35.997575 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-176fc18c-262c-46bc-a09e-6cb5d5ac1c03 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.330923 Jun 15 14:51:35.998120 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 84/174] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:35 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:37.014867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:37.015567 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:37.022161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:37.023210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:37.023829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:37.024312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:37.281019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:37.289803 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7e8b3ad6-ab30-48bf-a8e0-ae4d302d3605 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1321 microversion: 2.1 time: 0.279414 Jun 15 14:51:37.290401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:37 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:38.307467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:38.308127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:38.310603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=52 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:38.315738 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:38.316366 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:38.317130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:38.317560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:38.475328 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:38.486759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0164c7c2-11ec-4752-a7b5-bf03a9f9303b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1516 microversion: 2.1 time: 0.183477 Jun 15 14:51:38.487459 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:38 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:38.512010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:51:38.518918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:38.527483 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:38.528253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:38.529117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:38.529620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:38.600278 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'flavor' on Instance uuid 408e1d57-c792-4ac6-9112-a83dfc0cab85 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:51:38.635528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:39.034231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-827cbf41-1801-4527-ad25-0509eda42d1c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85/action" status: 200 len: 32 microversion: 2.1 time: 0.529051 Jun 15 14:51:39.034846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 92/177] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:51:38 2022] POST /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85/action => generated 32 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:51:39.046257 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:39.046968 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:39.054195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:39.054851 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:39.055744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:39.056280 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:39.059555 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:39.200263 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:39.214315 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-048a1521-6301-432c-83f1-90e6583fef9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.173363 Jun 15 14:51:39.214960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 86/178] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:39 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:40.232969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:40.233837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:40.240625 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:40.241147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:40.242731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:40.243172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:40.396048 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:40.404540 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a5823c6a-c341-4faa-a571-bbb0d8497420 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.176367 Jun 15 14:51:40.405126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 93/179] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:40 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:41.422292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:41.423117 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:41.431280 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:41.436629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:41.436629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:41.436629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:41.627665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:41.642501 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b9507014-a3c9-4486-a6a6-08bc95accad7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.223989 Jun 15 14:51:41.657612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 87/180] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:41 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:42.671355 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:42.671976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:42.678400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:42.679800 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.680647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:42.681253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:42.837899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:42.845582 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-40c5b50e-3dda-4033-bda9-a517ac651c54 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.178834 Jun 15 14:51:42.846163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 94/181] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:42 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:43.864271 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:43.864995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:43.873429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.873873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:43.874813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:43.875251 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:44.058862 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:44.068028 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-aba2ad31-cb34-42af-a7a2-0ee393d94f63 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.208413 Jun 15 14:51:44.068657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 88/182] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:43 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:45.087226 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:45.087849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:45.094569 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.095023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.095926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:45.096400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:45.286023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:45.295922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e1c6ce8e-9674-4c6f-973e-4b2300018963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.212885 Jun 15 14:51:45.296793 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 95/183] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:45 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:46.316882 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:46.317731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:46.325676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.326132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:46.326917 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:46.327386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:46.502405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:46.514476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3a2e1801-2530-4640-988a-e3082d84f8e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.201245 Jun 15 14:51:46.515156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 89/184] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:46 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:47.534132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:47.534744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:47.537022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=56 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:51:47.543342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:47.543921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:47.544925 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:47.545370 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:47.870300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:47.878316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-89300856-c6c2-435d-a58d-2049fa89eb8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.348358 Jun 15 14:51:47.878903 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 96/185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:47 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:48.896453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:48.897145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:48.903952 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.909521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:48.909521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:48.909521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:49.049534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:49.059457 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-24fcbe9e-b65b-4007-8809-3c464f731f85 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.167552 Jun 15 14:51:49.060053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 90/186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:48 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:50.077151 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:50.077790 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:50.083964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.084453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.085220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:50.085683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:50.232479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:50.240043 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-623bd1bc-ba0b-4dfa-8fb9-dd331009e79c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.166677 Jun 15 14:51:50.240623 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 97/187] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:50 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:51.257493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:51.258247 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:51.265696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.266141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.266901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:51.267332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:51.407621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:51.421822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a41c9178-dae4-49e6-8488-13c2a953f2dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.168376 Jun 15 14:51:51.422403 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 91/188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:51 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:52.438320 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:52.438958 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:52.445051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.445661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.446476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:52.446942 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:52.588260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:52.596504 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-574be11f-bc5f-43eb-a0f4-85faa80a1c5b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.161866 Jun 15 14:51:52.597113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 98/189] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:52 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:53.616562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:53.617623 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:53.624210 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.624658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.625443 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:53.625877 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:53.774037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:53.783088 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4e7dd3ef-0115-46f6-b943-a3ff103a7ecc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.170453 Jun 15 14:51:53.783598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 92/190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:53 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:54.488067 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:54.488532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:54.495903 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.496395 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.497189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.497646 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.527976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:51:54.801921 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:54.802827 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:54.821686 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.822239 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.823312 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.826134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.909966 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7376854f-a486-4298-b385-597306179722 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 204 len: 0 microversion: 2.1 time: 0.424523 Jun 15 14:51:54.911241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 99/191] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:51:54 2022] DELETE /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:51:54.922712 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:54.923934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:54.937712 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.937712 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:54.937712 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:54.937712 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:55.025189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:55.033042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e555e225-2eb5-4562-a4c4-def498f969eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.235529 Jun 15 14:51:55.033627 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 93/192] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:54 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:55.104111 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:55.118627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-17f04501-8d83-4cb3-aa58-e6dde3ae710c tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1552 microversion: 2.1 time: 0.200167 Jun 15 14:51:55.119721 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 100/193] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:54 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1552 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:56.055189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:56.055796 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:56.062481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:56.063091 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.064058 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:56.064525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.137548 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:56.138272 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:56.150316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:56.151919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.152814 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:56.154433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:56.388843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:56.411580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8a226833-1e10-4f42-80d9-f95c119853a1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.360169 Jun 15 14:51:56.413399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 94/194] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:56 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:56.419632 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:56.431999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ce78fa2e-01a8-497a-81bd-a314bb3ea7da tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1552 microversion: 2.1 time: 0.299576 Jun 15 14:51:56.433103 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 101/195] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:56 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1552 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:57.431462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:57.432116 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:57.442589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.443357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.444761 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.446015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.458953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:57.460476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:57.474980 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.475440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.476259 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:57.478512 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:57.741851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:57.745952 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:57.754053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-89d6cf34-e253-4186-9631-5f16a0657518 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.327726 Jun 15 14:51:57.764796 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 95/196] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:57 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:57.766374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6144a76d-b4e9-4255-9caa-9d3d0512e68f tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1552 microversion: 2.1 time: 0.311128 Jun 15 14:51:57.766972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 102/197] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:57 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1552 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:51:58.772167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:58.774310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:58.779754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.780260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.781043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.781465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.784513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:51:58.785132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:51:58.793227 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.793953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.794916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:51:58.795562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:51:58.992505 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:58.997469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:51:59.003090 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-aa46045d-4c56-4136-a787-2339e65ed525 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.234417 Jun 15 14:51:59.004431 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 96/198] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:58 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:51:59.018539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2190970e-d5d8-4977-a876-c09448272641 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1552 microversion: 2.1 time: 0.237751 Jun 15 14:51:59.019203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 103/199] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:51:58 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:00.021940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:00.022564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:00.030873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.031381 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:00.032253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.032905 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:00.037126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:00.037899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:00.045313 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.046009 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:00.046989 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:00.047759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:00.261925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:00.270197 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:00.281732 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7de1430c-2939-42ea-a7cf-428ebbbcdd86 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1552 microversion: 2.1 time: 0.247195 Jun 15 14:52:00.283935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0c7f36f9-a15f-44bd-b87d-c7ae8aa84081 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.265662 Jun 15 14:52:00.284699 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 104/200] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:00 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1552 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:00.297578 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 97/201] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:00 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:01.301655 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:01.302454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:01.312403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.313225 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.314480 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.315192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.324546 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:01.324546 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:01.332431 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.333135 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.334182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:01.334962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:01.553698 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:01.558262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:01.562382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:01.563743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9caee16e-71ae-4948-ba16-b54d0ffe6638 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1552 microversion: 2.1 time: 0.265977 Jun 15 14:52:01.564369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 105/202] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:01 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1552 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:01.571382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7daaf437-e3d5-4b56-8a58-307c9bc24e8b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.257145 Jun 15 14:52:01.571956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 98/203] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:01 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:02.583366 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:02.584628 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:02.589133 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:02.590293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:02.591963 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.592474 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.593478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.593913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.596472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.597144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.597916 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.598508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:02.819011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:02.822615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:02.832890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-923b4776-ef81-4708-9835-d0be6a6e1b52 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.248169 Jun 15 14:52:02.833653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 99/204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:02 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:02.834411 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-29e5da6c-3daa-4010-a6b9-a3ec68c4b134 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1552 microversion: 2.1 time: 0.256412 Jun 15 14:52:02.835194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 106/205] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:02 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1552 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:02.987111 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-3b4d3fd7-be43-4875-9306-ecf34d84ea28 req-640ec7ee-c0e6-427c-8c23-f8b403c5f009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6aca7e8-506a-4eb2-bcc3-601589cff5b5", "name": "network-vif-deleted", "tag": "7b71bdf0-f5cd-48fa-82ed-70c693a442c3"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:02.996508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-3b4d3fd7-be43-4875-9306-ecf34d84ea28 req-640ec7ee-c0e6-427c-8c23-f8b403c5f009 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:02.996957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-3b4d3fd7-be43-4875-9306-ecf34d84ea28 req-640ec7ee-c0e6-427c-8c23-f8b403c5f009 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.009439 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-3b4d3fd7-be43-4875-9306-ecf34d84ea28 req-640ec7ee-c0e6-427c-8c23-f8b403c5f009 service nova] Creating event network-vif-deleted:7b71bdf0-f5cd-48fa-82ed-70c693a442c3 for instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 on hv-cinder-78729 Jun 15 14:52:03.015004 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-3b4d3fd7-be43-4875-9306-ecf34d84ea28 req-640ec7ee-c0e6-427c-8c23-f8b403c5f009 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031521 Jun 15 14:52:03.015608 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 100/206] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:03.865190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:03.865970 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:03.866498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:03.866749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:03.874054 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.874314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.874501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.875141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.875271 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.875688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.875978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:03.876446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:03.997213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:04.006282 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8fc6432b-83d5-4327-bc48-4a093817fa74 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1510 microversion: 2.1 time: 0.145262 Jun 15 14:52:04.006911 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 101/207] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:03 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:04.105220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:04.105220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-95c8ef63-bca7-4458-ba69-2e0bdee32ce1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.244686 Jun 15 14:52:04.105577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 107/208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:03 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:05.025197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:05.025848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:05.032990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.033439 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.034215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.034652 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.098195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:05.107507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-36b1b483-a907-4ed0-a56f-749b81a4e22b tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1510 microversion: 2.1 time: 0.086360 Jun 15 14:52:05.108317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 102/209] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:05 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1510 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:05.122521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:05.123163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:05.129366 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.129812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.130576 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:05.131015 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:05.270916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:05.279360 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ee9fdda2-4d45-4706-8960-060db892ee16 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.161305 Jun 15 14:52:05.279988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 108/210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:05 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:06.126334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:06.126966 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:06.134931 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.135388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.136467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.136905 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.292699 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:06.299664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:06.306150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:06.315139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.315637 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.318819 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:06.319162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:06.362657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:06.373409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5f464846-73f5-4188-a2f0-a803b4ab200d tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1510 microversion: 2.1 time: 0.252138 Jun 15 14:52:06.373990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 103/211] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:06 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:06.487410 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:06.496856 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9d784d1c-4c60-4e2a-b6b0-adeec98096f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.201518 Jun 15 14:52:06.497574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:06 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:07.390981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:07.392547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:07.400357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:07.400898 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:07.401577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:07.402013 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:07.514191 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:07.514936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:07.522563 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:07.523611 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:07.525049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:07.525634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:07.744058 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:07.760249 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-78ff1376-7f1f-4958-91c7-f7bec9a48d3a tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1345 microversion: 2.1 time: 0.373364 Jun 15 14:52:07.761189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 104/213] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:07 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1345 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:07.842369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:07.853650 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6f8b32e3-7fdb-43e4-85f1-808196773efa tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.343297 Jun 15 14:52:07.854705 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 110/214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:07 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:08.778346 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:08.778979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:08.785666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.786118 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.786880 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.787316 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.819519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.819967 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.820451 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lazy-loading 'fault' on Instance uuid f6aca7e8-506a-4eb2-bcc3-601589cff5b5 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:52:08.873765 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95d993b6ed24073bbf1618ab4d1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e498ac8b52d4a068016e44c094996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:08.878452 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:08.878452 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:08.881398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.881965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.882960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:08.883479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:08.885196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e8dc37d3-c397-4dae-864c-01775b211516 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 200 len: 1350 microversion: 2.1 time: 0.111030 Jun 15 14:52:08.885791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 105/215] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:08 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:09.043488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:09.057512 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-abe5e0e2-8360-4877-8d78-b77cf0f1ac71 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.185315 Jun 15 14:52:09.057512 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 111/216] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:08 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:09.903730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:09.908586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:09.914438 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=44 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:09.920821 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:09.921993 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:09.923538 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:09.924115 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:09.939363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] HTTP exception thrown: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Request method failure captured: Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 HTTP/1.1 Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGdiNp60XGrscTFDnM88VJjbKVv3ts8QvJknVcI5V1YVMHHUY_23umGHqtN29N6stmWcPYY0mbzviWfU2B3JBKE5K7MRBrR7_vBTPXSnnERks_ORp4PMuvlQgdzR74yGvAk94DBRwJm4t26MfQei5MrmpjTZYpi4-Dd30_MWQVHp_8 Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:52:09.948057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: e95d993b6ed24073bbf1618ab4d1118e Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:09.949771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'f6aca7e8-506a-4eb2-bcc3-601589cff5b5'} Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:09.950613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:09.952006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:09.954031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Returning 404 to user: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:09.954031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1c4b0e5d-fd30-4b4e-b1d8-41997e3324ed tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 404 len: 111 microversion: 2.1 time: 0.052200 Jun 15 14:52:09.954031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 106/217] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:09 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:10.061933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:10.063105 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:10.070052 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.070531 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:10.070654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.072189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:10.072478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.073268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.080130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.080710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.081577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:10.082259 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:10.091421 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] HTTP exception thrown: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Request method failure captured: Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5/os-volume_attachments HTTP/1.1 Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfGdiNp60XGrscTFDnM88VJjbKVv3ts8QvJknVcI5V1YVMHHUY_23umGHqtN29N6stmWcPYY0mbzviWfU2B3JBKE5K7MRBrR7_vBTPXSnnERks_ORp4PMuvlQgdzR74yGvAk94DBRwJm4t26MfQei5MrmpjTZYpi4-Dd30_MWQVHp_8 Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:52:10.103617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: e95d993b6ed24073bbf1618ab4d1118e Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:10.106070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'server_id': 'f6aca7e8-506a-4eb2-bcc3-601589cff5b5'} Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:10.107364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:10.110891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:10.114281 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Returning 404 to user: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:10.114281 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a962a4d7-ebd1-4b29-a0cc-82cf23dbd7ce tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047593 Jun 15 14:52:10.114281 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 112/218] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:52:10 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:10.301465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:10.311354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-34c50c85-191b-4b5b-a978-6c6c42c2bef3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.244852 Jun 15 14:52:10.316944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 107/219] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:10 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:11.333028 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:11.333660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:11.340844 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:11.341296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:11.342081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:11.342706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:11.534000 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:11.556749 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3afce031-5b58-4a5c-8d15-d42f624b6ea1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.227403 Jun 15 14:52:11.569635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 113/220] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:11 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:12.580638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:12.588843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:12.591751 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.592269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.593039 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:12.593505 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:12.725870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:12.734228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-feefb4df-9e31-491e-9e48-c74d7a1cb528 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.159916 Jun 15 14:52:12.734795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 108/221] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:12 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:13.750544 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:13.751163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:13.757229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:13.757682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:13.758460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:13.759548 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:13.916866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:13.926158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d5f97d8f-fa7b-4579-87a4-6d4c2c704993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.179352 Jun 15 14:52:13.928405 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 114/222] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:13 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:14.943127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:14.943755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:14.951913 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.952397 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:14.953184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:14.953657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:15.128012 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:15.136610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2d5824de-0b8b-42d5-aa6f-3987d375683e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.197016 Jun 15 14:52:15.137260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 109/223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:14 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:16.154457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:16.155081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:16.163543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.163543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.163543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.163543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.320513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:16.330115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6ca14407-c49c-496c-b821-2598fe823219 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.179659 Jun 15 14:52:16.330708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 115/224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:16 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:16.830402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:16.831025 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:16.845924 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.846397 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.847211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.847658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.862405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] HTTP exception thrown: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Request method failure captured: Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: DELETE /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 HTTP/1.1 Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGdiNp60XGrscTFDnM88VJjbKVv3ts8QvJknVcI5V1YVMHHUY_23umGHqtN29N6stmWcPYY0mbzviWfU2B3JBKE5K7MRBrR7_vBTPXSnnERks_ORp4PMuvlQgdzR74yGvAk94DBRwJm4t26MfQei5MrmpjTZYpi4-Dd30_MWQVHp_8 Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:52:16.863896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: e95d993b6ed24073bbf1618ab4d1118e Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.865288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'f6aca7e8-506a-4eb2-bcc3-601589cff5b5'} Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:16.866638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.867928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.869556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Returning 404 to user: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:16.869556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9900ff1a-b6b8-4aa5-a1af-799ede002006 tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 404 len: 111 microversion: 2.1 time: 0.039636 Jun 15 14:52:16.869556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 110/225] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:52:16 2022] DELETE /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:52:16.874504 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:16.875300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] [instance: f6aca7e8-506a-4eb2-bcc3-601589cff5b5] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:16.881723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.882383 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.883105 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:16.884175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:16.904892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] HTTP exception thrown: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Request method failure captured: Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 HTTP/1.1 Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfGdiNp60XGrscTFDnM88VJjbKVv3ts8QvJknVcI5V1YVMHHUY_23umGHqtN29N6stmWcPYY0mbzviWfU2B3JBKE5K7MRBrR7_vBTPXSnnERks_ORp4PMuvlQgdzR74yGvAk94DBRwJm4t26MfQei5MrmpjTZYpi4-Dd30_MWQVHp_8 Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:52:16.907051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0e498ac8b52d4a068016e44c094996c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 0e498ac8b52d4a068016e44c094996c1 Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-DeleteServersTestJSON-909972188 Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: e95d993b6ed24073bbf1618ab4d1118e Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-DeleteServersTestJSON-909972188-project Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.908492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'f6aca7e8-506a-4eb2-bcc3-601589cff5b5'} Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:16.909471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. Jun 15 14:52:16.910895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:52:16.912042 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] Returning 404 to user: Instance f6aca7e8-506a-4eb2-bcc3-601589cff5b5 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:16.912042 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-be979d85-5edf-4ab6-83a4-d1553d5987cd tempest-DeleteServersTestJSON-909972188 tempest-DeleteServersTestJSON-909972188-project] 10.222.0.42 "GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5" status: 404 len: 111 microversion: 2.1 time: 0.037782 Jun 15 14:52:16.912601 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 116/226] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:16 2022] GET /compute/v2.1/servers/f6aca7e8-506a-4eb2-bcc3-601589cff5b5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:52:17.346902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:17.347522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:17.354386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:17.354992 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:17.355802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:17.362920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:17.503668 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:17.516984 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bb957a62-fcca-4383-b738-41c0eb84e426 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.173840 Jun 15 14:52:17.517648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 111/227] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:17 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:18.534829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:18.535439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:18.537340 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:18.542327 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:18.543091 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:18.552429 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:18.552429 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:18.703972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:18.711762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e34e4bba-cba7-4df7-a3fd-5866f6c621bd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.180771 Jun 15 14:52:18.712360 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 117/228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:18 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:19.729285 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:19.729907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:19.737477 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:19.737477 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:19.738167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:19.738884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:19.883903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:19.896708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e3b6ed23-de83-46ef-9a89-706125f66ef5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.171510 Jun 15 14:52:19.897951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 112/229] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:19 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:20.916583 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:20.917403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:20.924235 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:20.924811 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:20.925602 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:20.926066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:21.079445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:21.088241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f13530a8-9f9e-4b26-9164-43873bfc04d4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.176637 Jun 15 14:52:21.088832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 118/230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:20 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:22.105282 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:22.109153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:22.113589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:22.114049 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:22.114836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:22.115276 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:22.266544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:22.275954 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-abc5993e-5763-405c-b7c0-df8aec0fffc2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.175442 Jun 15 14:52:22.276678 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:22 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:23.293010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:23.293629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:23.307270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:23.307782 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:23.308537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:23.308981 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:23.500141 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:23.509131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0e116162-1682-4759-b261-43e45eeec315 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.219716 Jun 15 14:52:23.509514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 119/232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:23 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:24.526339 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:24.526947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:24.535104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:24.535556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:24.536401 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:24.536842 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:24.778119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:24.792647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3ab14234-65d0-42bf-8c0d-86f4bf68a137 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.270540 Jun 15 14:52:24.794109 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 114/233] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:24 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:25.776663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5e662287-6105-495c-a8a3-202102fc4093 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'create', calling method: .version_select at 0x7fb8a867de50>, body: {"keypair": {"name": "tempest-keypair-102436053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMd2PgKdFxQUSUebhc0ahrWOjI+9py7voHc7zHgpE/2iG05l0jU8z3417dOfq8RdMW1Fy350UAYKjB6fi4X+3dXabu1c/q6EuX2S8JH4OcOokrTcRazX6rD/IqtPHPrLjw=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:25.794859 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-5e662287-6105-495c-a8a3-202102fc4093 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for project f9c28220b6ea4db99f81a37e0794450b. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:52:25.799717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-5e662287-6105-495c-a8a3-202102fc4093 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for user 2dcc02eb960e45b99587438aa3696f40 and project f9c28220b6ea4db99f81a37e0794450b. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:52:25.811765 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:25.813669 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:25.826816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:25.827886 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:25.830038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:25.832205 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:25.907040 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5e662287-6105-495c-a8a3-202102fc4093 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.349866 Jun 15 14:52:25.907658 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 120/234] 10.222.0.42 () {62 vars in 1199 bytes} [Wed Jun 15 14:52:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 352 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 14:52:26.005796 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:26.017694 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d4d273af-b104-4f0f-b89f-d6f6e5663aa6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.210158 Jun 15 14:52:26.027514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 115/235] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:25 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:27.035371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:27.038276 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:27.049343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:27.049794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:27.050783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:27.051502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:27.265598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:27.277287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8f372059-8e2b-4f07-9da9-2cea582c7102 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.244850 Jun 15 14:52:27.277287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 121/236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:27 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:28.301263 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:28.301994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:28.309769 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:28.312013 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:28.313368 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:28.314027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:28.522338 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:28.530427 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ffbe0eed-0a60-4927-9c76-125594b1ed13 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1522 microversion: 2.1 time: 0.240574 Jun 15 14:52:28.530995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 116/237] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:28 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:28.622782 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1397643841", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "321d9204-351d-4464-9bb3-7cb5dc9d97e0"}], "security_groups": [{"name": "tempest-securitygroup--1833399276"}], "key_name": "tempest-keypair-102436053", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:28.741299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] validate_networks() for [('321d9204-351d-4464-9bb3-7cb5dc9d97e0', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:52:29.210250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:52:29.210696 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:52:29.211158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:52:29.212232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:52:29.212752 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:52:29.223413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.223695 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.224612 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.225237 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.248370 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for project f9c28220b6ea4db99f81a37e0794450b. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:52:29.252909 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for user 2dcc02eb960e45b99587438aa3696f40 and project f9c28220b6ea4db99f81a37e0794450b. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:52:29.270530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:52:29.271504 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:52:29.528331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cb0ef3c5-c82c-48df-9be1-452e0312d104 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.910665 Jun 15 14:52:29.529910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 122/238] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Jun 15 14:52:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 14:52:29.549836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.550730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.551719 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6e223351-5de1-4e1e-8c25-952f0464fbcc tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.554682 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6e223351-5de1-4e1e-8c25-952f0464fbcc tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.560190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.560883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.562077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.562702 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.657658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6e223351-5de1-4e1e-8c25-952f0464fbcc tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.681859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6e223351-5de1-4e1e-8c25-952f0464fbcc tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.714149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6e223351-5de1-4e1e-8c25-952f0464fbcc tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.720073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6e223351-5de1-4e1e-8c25-952f0464fbcc tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1281 microversion: 2.20 time: 0.175380 Jun 15 14:52:29.737164 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 117/239] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:29 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:29.851589 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:29.864738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6097e7eb-c87a-4017-bc67-612fd478ab8c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1502 microversion: 2.1 time: 0.320879 Jun 15 14:52:29.869118 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 123/240] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:29 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1502 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:29.896372 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:29.897714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:29.912716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.913595 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:29.915170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:29.916358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:30.155282 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:30.165080 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-94534e45-9a2e-4a6b-bf12-5b2c6dad3153 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1515 microversion: 2.1 time: 0.274493 Jun 15 14:52:30.167289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 118/241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:29 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:30.755910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c8823e9c-f949-428b-bfe3-b8b5225efc6d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:30.756532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c8823e9c-f949-428b-bfe3-b8b5225efc6d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:30.816585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c8823e9c-f949-428b-bfe3-b8b5225efc6d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:30.825737 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c8823e9c-f949-428b-bfe3-b8b5225efc6d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:30.827241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c8823e9c-f949-428b-bfe3-b8b5225efc6d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:30.828392 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c8823e9c-f949-428b-bfe3-b8b5225efc6d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1281 microversion: 2.20 time: 0.076320 Jun 15 14:52:30.828944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 124/242] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:30 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:31.846801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:31.847457 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:31.854400 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.854845 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.855624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:31.856056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:31.925788 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:31.934126 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:31.935642 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:31.936775 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a0ad05b9-f021-4bce-a1ac-3d1a5b26e192 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1333 microversion: 2.20 time: 0.094040 Jun 15 14:52:31.937330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 119/243] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:31 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:32.958234 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:32.958848 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:32.967296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:32.967737 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:32.968547 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:32.968980 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:33.069786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:33.079968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:33.081653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:33.083116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f75b18a7-48c7-4631-bf6d-56ff85ba8765 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1339 microversion: 2.20 time: 0.129011 Jun 15 14:52:33.083796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 125/244] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:32 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:33.374357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:33.375994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:33.382993 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:33.383996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:33.384826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:33.385263 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:33.412602 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'flavor' on Instance uuid b65023b0-7f40-4b7f-85e5-91006b438f4c {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:52:33.614086 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:33.820831 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b7440984-ee5a-42af-8ed3-cca1ad211d07 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c/action" status: 200 len: 32 microversion: 2.1 time: 0.451531 Jun 15 14:52:33.821485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 120/245] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:52:33 2022] POST /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c/action => generated 32 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:52:33.831029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:33.831665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:33.839151 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:33.839949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:33.841236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:33.841851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:33.862409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:34.087696 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:34.104030 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:34.105669 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:34.111233 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9b78f70d-0fd9-4d0c-b75b-0e94581b573f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.284164 Jun 15 14:52:34.118309 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 126/246] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:33 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:34.118508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:34.118508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:34.120479 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:34.121133 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:34.342974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:34.357673 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:34.360828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:34.362420 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-848fb603-bba9-4040-ab44-8d395687a7ed tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.263774 Jun 15 14:52:34.363737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 121/247] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:34 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:34.462663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-af634694-4841-4131-9391-3de3abd7c437 req-4527fada-d828-4cf7-b78f-d93d9ec85910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdd536d-6f70-49a7-81e9-5a8d9a874132", "tag": "63af79cd-c2b3-45e8-8480-b3fcb4df3beb"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:34.479410 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-af634694-4841-4131-9391-3de3abd7c437 req-4527fada-d828-4cf7-b78f-d93d9ec85910 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:34.479860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-af634694-4841-4131-9391-3de3abd7c437 req-4527fada-d828-4cf7-b78f-d93d9ec85910 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:34.493183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-af634694-4841-4131-9391-3de3abd7c437 req-4527fada-d828-4cf7-b78f-d93d9ec85910 service nova] Creating event network-changed:63af79cd-c2b3-45e8-8480-b3fcb4df3beb for instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 on hv-cinder-78729 Jun 15 14:52:34.499698 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-af634694-4841-4131-9391-3de3abd7c437 req-4527fada-d828-4cf7-b78f-d93d9ec85910 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042840 Jun 15 14:52:34.500740 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 127/248] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:35.130700 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:35.131350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:35.139135 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:35.139592 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:35.140420 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:35.140863 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:35.366404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:35.386940 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:35.388405 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:35.396382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-19815e72-3205-4f00-be0f-6dbd6a34ca9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.269395 Jun 15 14:52:35.396977 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 122/249] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:35 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:35.397325 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:35.398211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:35.399883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:35.400615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:35.669689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:35.684512 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:35.687540 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:35.689002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-28d99f88-2a40-4029-a439-a33b0dfe71a6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.310344 Jun 15 14:52:35.692142 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 128/250] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:35 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:36.413533 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:36.414143 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:36.421473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.421845 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.422615 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.423092 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.561704 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:36.569448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5acc2766-b2cd-43dc-985e-6d2d84441fc7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.160009 Jun 15 14:52:36.570025 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 123/251] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:36 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:36.707584 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:36.708381 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:36.714845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.715361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.716164 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:36.719670 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:36.864558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:36.873651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:36.875185 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:36.876558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a48f4175-449a-48c9-a8c0-49af4bf63fc9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.173036 Jun 15 14:52:36.887668 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 129/252] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:36 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:37.587552 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:37.588385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:37.596066 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.596610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.597386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.598034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.769761 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:37.784986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e13dba98-a38e-4292-a9dc-df9a590b23c0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.201244 Jun 15 14:52:37.786125 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 124/253] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:37 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:37.896475 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:37.897261 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:37.904371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.904831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:37.905666 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:37.906112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.057953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:38.068689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:38.070207 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:38.072168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-adad6799-e1f1-44d1-9259-259e78216421 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.179650 Jun 15 14:52:38.072946 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 130/254] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:37 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:38.802960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:38.803652 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:38.812483 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:38.813181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.813973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:38.814591 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:38.999540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:39.007745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-054b4a76-4118-45b1-ad04-81ce3a67a511 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.208756 Jun 15 14:52:39.009407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 125/255] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:38 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:39.091674 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:39.093166 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:39.104222 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:39.106528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:39.108650 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:39.111528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:39.234517 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:39.527962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:39.546503 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:39.548030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:39.549312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ae3a5182-fc70-4b61-8ac5-84b25583ce3e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.461569 Jun 15 14:52:39.549961 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 131/256] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:39 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:40.029216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:40.031577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:40.033742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:40.039341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.042073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.042073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.042073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.231640 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:40.255009 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1fd2582f-a421-4112-8646-587a1ab58b68 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.231657 Jun 15 14:52:40.266166 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 126/257] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:40 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:40.567602 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:40.568283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:40.574735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.575190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.575970 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:40.576456 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:40.736513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:40.746971 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:40.748677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:40.749841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7fa55e3e-c90a-4e7d-9388-4e0a3440901b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.186391 Jun 15 14:52:40.750616 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 132/258] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:40 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:41.273973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:41.276123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:41.278520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=44 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:41.283569 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.284198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.285562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.286074 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.453233 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:41.463512 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-72e01975-f97b-456f-8e22-2c39f04f8cc5 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.194476 Jun 15 14:52:41.464269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 127/259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:41 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:41.770933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:41.772497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:41.774317 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=12 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:41.780019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.780746 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.781601 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:41.782115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:41.969917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:41.979265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:41.980852 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:41.982015 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3190e000-b699-482b-a63f-63e86b6091be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.215181 Jun 15 14:52:41.982581 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 133/260] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:41 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:42.481018 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:42.481694 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:42.488382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:42.488842 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:42.489632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:42.490073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:42.675396 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:42.685886 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d1cf709f-6dbe-4156-92a7-7868b9231fd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.209009 Jun 15 14:52:42.687540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 128/261] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:42 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:43.002817 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:43.003873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:43.012663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:43.012663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:43.012663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:43.013091 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:43.172425 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:43.184896 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:43.186865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:43.188015 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c9e0d277-40db-4286-97c7-32282626545a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.189132 Jun 15 14:52:43.188618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 134/262] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:42 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:43.713472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:43.713472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:43.713472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:43.718562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:43.718562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:43.718562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:43.866262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:43.881354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-40330f5b-3b19-46e5-98d6-26d50af9f2fd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.180729 Jun 15 14:52:43.881931 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 129/263] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:43 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:44.207804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:44.208518 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:44.215709 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:44.216411 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:44.217440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:44.218029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:44.396803 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:44.407125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:44.409354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:44.410485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8612b9d6-babb-4fc0-9621-aac6b8434a01 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.207574 Jun 15 14:52:44.411268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 135/264] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:44 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:44.908455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:44.909264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:44.916494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:44.916942 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:44.917988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:44.918967 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.098945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:45.107792 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-aac0438e-76a5-4da9-b76b-6d1a23c64f7b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.204139 Jun 15 14:52:45.108405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 130/265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:44 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:45.434336 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:45.434831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:45.441718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.442501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.443868 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:45.444707 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:45.629008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:45.643961 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:45.647073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:45.649313 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-805e5b09-8f4d-4110-966c-be3bf5d20905 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.219445 Jun 15 14:52:45.650027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 136/266] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:45 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:46.132132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:46.132856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:46.142591 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.143046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.143971 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.144476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.332412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:46.341434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3cd725b5-00a6-4fab-83d0-c2ada965f5dc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.213164 Jun 15 14:52:46.342435 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 131/267] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:46 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:46.670656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:46.671392 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:46.677861 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.678555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.679419 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:46.680524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:46.827597 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:46.846864 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:46.849418 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:46.850871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7ae8ecb2-63d3-4c2b-8a84-f2c97d6b945f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.183925 Jun 15 14:52:46.856939 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 137/268] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:46 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:47.189475 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-113c17b9-b536-4b56-9a2f-1a1243b64efa req-8d7ffcc9-4043-4ec5-9bbb-a6a65394189c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdd536d-6f70-49a7-81e9-5a8d9a874132", "name": "network-vif-plugged", "status": "completed", "tag": "63af79cd-c2b3-45e8-8480-b3fcb4df3beb"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:47.203451 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-113c17b9-b536-4b56-9a2f-1a1243b64efa req-8d7ffcc9-4043-4ec5-9bbb-a6a65394189c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:47.204288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-113c17b9-b536-4b56-9a2f-1a1243b64efa req-8d7ffcc9-4043-4ec5-9bbb-a6a65394189c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:47.224457 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-113c17b9-b536-4b56-9a2f-1a1243b64efa req-8d7ffcc9-4043-4ec5-9bbb-a6a65394189c service nova] Creating event network-vif-plugged:63af79cd-c2b3-45e8-8480-b3fcb4df3beb for instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 on hv-cinder-78729 Jun 15 14:52:47.227042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-113c17b9-b536-4b56-9a2f-1a1243b64efa req-8d7ffcc9-4043-4ec5-9bbb-a6a65394189c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043744 Jun 15 14:52:47.227910 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 132/269] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:47.363797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:47.364605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:47.372440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:47.372895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:47.373681 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:47.374426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:47.522947 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:47.541242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e6b67ad5-0389-4c21-9f73-a59a6f5ed441 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.181728 Jun 15 14:52:47.542087 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 138/270] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:47 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:47.870739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:47.871455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:47.877895 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:47.878357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:47.879166 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:47.879579 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:48.082760 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:48.111289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:48.115488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:48.118698 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-095e541c-6bff-4d47-b89c-dc8116b2e531 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.252479 Jun 15 14:52:48.119467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 133/271] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:47 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:48.563552 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:48.564285 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:48.575974 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:48.576472 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:48.577252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:48.577692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:48.759996 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:48.769198 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9ef5d121-cf8d-401b-bbc5-e3806206c659 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.209599 Jun 15 14:52:48.769777 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 139/272] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:48 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:49.158854 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:49.160129 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:49.168740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:49.169289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:49.169971 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:49.170416 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:49.386282 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:49.399248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:49.401407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:49.402663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5b946e78-df66-44fb-be6c-714de41552a5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.251682 Jun 15 14:52:49.403240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 134/273] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:49 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:49.792340 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:49.792954 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:49.799193 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:49.799640 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:49.800433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:49.800863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:49.957171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:49.968027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-01092dda-920b-4909-971b-ff4f1c344dab tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.184194 Jun 15 14:52:49.968949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 140/274] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:49 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:50.427802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:50.428917 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:50.439293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:50.439963 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:50.441267 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:50.441873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:50.636334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:50.645749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:50.648112 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:50.650127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-74b7c97a-7047-459e-8133-35b3f652d910 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.229688 Jun 15 14:52:50.650701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 135/275] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:50 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:50.992995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:50.993923 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:51.005683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.006271 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.007593 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.008354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.190264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:51.199372 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f7aee449-19da-47d0-8f38-8983db3b9654 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1501 microversion: 2.1 time: 0.213162 Jun 15 14:52:51.199943 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 141/276] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:50 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1501 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:51.217298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd73017d-cfb9-414f-8033-13bd81ecf94f"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:51.218773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:51.225360 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.226027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.227525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.228261 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.264616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] HTTP exception thrown: Cannot 'attach_volume' instance b65023b0-7f40-4b7f-85e5-91006b438f4c while it is in vm_state rescued Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Request method failure captured: Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: POST /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c/os-volume_attachments HTTP/1.1 Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 74 Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGs03oh-7kSWYEU1WMxWuCiS0GOth0nCtL3a7M4Nu4Ptc6aA4SWz0jlPSSy-cea0qKebLVF_7YbJboLQvV4Ez2nhvOybApFnbmS35KDfFVMDoyjGvyfaKV90cRJB01Qx5v25Xft1YZm-QTfkqtINUpwcIMmaiiOa6JhzOC173v-UIQ Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:52:51.266856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: ee9df934d1cd461abbf9c3cd90a8fdda Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {"volumeAttachment": {"volumeId": "bd73017d-cfb9-414f-8033-13bd81ecf94f"}} Jun 15 14:52:51.268811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Cannot 'attach_volume' instance b65023b0-7f40-4b7f-85e5-91006b438f4c while it is in vm_state rescued Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'server_id': 'b65023b0-7f40-4b7f-85e5-91006b438f4c', 'body': {'volumeAttachment': {'volumeId': 'bd73017d-cfb9-414f-8033-13bd81ecf94f'}}} Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b65023b0-7f40-4b7f-85e5-91006b438f4c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:52:51.273708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b65023b0-7f40-4b7f-85e5-91006b438f4c while it is in vm_state rescued Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:52:51.276388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:52:51.278953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:52:51.278953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:52:51.278953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b65023b0-7f40-4b7f-85e5-91006b438f4c while it is in vm_state rescued Jun 15 14:52:51.278953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:52:51.278953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Returning 409 to user: Cannot 'attach_volume' instance b65023b0-7f40-4b7f-85e5-91006b438f4c while it is in vm_state rescued {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:52:51.278953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-18413eec-054a-4647-b3db-9d7f7184e142 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055175 Jun 15 14:52:51.278953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 136/277] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 14:52:51 2022] POST /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:52:51.282507 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c0139477-9aad-441b-9601-d15f2b0cc960 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:51.283021 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c0139477-9aad-441b-9601-d15f2b0cc960 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:51.284950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:51.297183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0139477-9aad-441b-9601-d15f2b0cc960 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.298849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0139477-9aad-441b-9601-d15f2b0cc960 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.300853 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0139477-9aad-441b-9601-d15f2b0cc960 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.301715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0139477-9aad-441b-9601-d15f2b0cc960 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.473180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:51.577382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c0139477-9aad-441b-9601-d15f2b0cc960 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c/action" status: 202 len: 0 microversion: 2.1 time: 0.297384 Jun 15 14:52:51.578092 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 142/278] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:52:51 2022] POST /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:52:51.589380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:51.590916 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:51.598383 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.603075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.603075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.606321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.680711 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:51.681975 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:51.694433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.702782 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.702782 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:51.702782 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:51.859386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:51.870707 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:52:51.874677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-02d2b06a-8713-41af-b8d0-aea63e70b935 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.291435 Jun 15 14:52:51.884248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 137/279] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:51 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:51.943625 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:51.948844 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:51.950654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:51.951907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2c1de01f-3bcb-4041-902f-fb98f4748984 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1407 microversion: 2.20 time: 0.278241 Jun 15 14:52:51.952543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 143/280] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:51 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:52:52.893198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:52.897026 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:52.902006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:52.902457 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:52.903239 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:52.903920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:52.975606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:52.976867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:52.984315 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:52.984913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:52.985832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:52.986651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:53.283233 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:53.301179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ca31d91a-365e-415e-8366-11af55aca34e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.411540 Jun 15 14:52:53.302071 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 138/281] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:52 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:53.363995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:53.381011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:53.384677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:53.390150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b9128853-17eb-4330-92b2-da7c7230b853 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1599 microversion: 2.20 time: 0.420167 Jun 15 14:52:53.390150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 144/282] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:52:52 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1599 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:52:53.417630 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-67143c05-b341-4940-9fb9-3fe648f830c5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:53.418518 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-67143c05-b341-4940-9fb9-3fe648f830c5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:53.427814 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-67143c05-b341-4940-9fb9-3fe648f830c5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:53.430123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-67143c05-b341-4940-9fb9-3fe648f830c5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:53.430747 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-67143c05-b341-4940-9fb9-3fe648f830c5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:53.431268 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-67143c05-b341-4940-9fb9-3fe648f830c5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:53.527082 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-67143c05-b341-4940-9fb9-3fe648f830c5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116853 Jun 15 14:52:53.527863 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 139/283] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Jun 15 14:52:53 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:52:54.319693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:54.325614 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:54.328715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:54.329220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:54.330063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:54.330510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:54.631598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:54.640715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5799ec19-05dc-4029-8f03-5d383d27939c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.325041 Jun 15 14:52:54.641307 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 145/284] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:54 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:52:55.241400 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-8613319a-9304-4c22-b329-e0e1d91c9b2b req-177ee597-1524-4caa-978f-5bb5238bd19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdd536d-6f70-49a7-81e9-5a8d9a874132", "tag": "63af79cd-c2b3-45e8-8480-b3fcb4df3beb"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:52:55.252130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8613319a-9304-4c22-b329-e0e1d91c9b2b req-177ee597-1524-4caa-978f-5bb5238bd19a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:55.252871 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8613319a-9304-4c22-b329-e0e1d91c9b2b req-177ee597-1524-4caa-978f-5bb5238bd19a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:55.269120 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-8613319a-9304-4c22-b329-e0e1d91c9b2b req-177ee597-1524-4caa-978f-5bb5238bd19a service nova] Creating event network-changed:63af79cd-c2b3-45e8-8480-b3fcb4df3beb for instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 on hv-cinder-78729 Jun 15 14:52:55.274649 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-8613319a-9304-4c22-b329-e0e1d91c9b2b req-177ee597-1524-4caa-978f-5bb5238bd19a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038299 Jun 15 14:52:55.276208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 140/285] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:52:55.666942 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:55.667563 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:55.674176 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:55.674527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:55.675299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:55.675946 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:55.833924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:55.842539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f790a610-9d55-4a08-b800-0f8a77672058 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.180056 Jun 15 14:52:55.843126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 146/286] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:55 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:56.865484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:56.867103 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:56.877393 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:56.877997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:56.879151 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:56.879689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:57.049533 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:57.061198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3a6cf8f5-a5da-418c-b22f-275d5abab6a9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.203183 Jun 15 14:52:57.062109 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 141/287] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:56 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:58.086101 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:58.086771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:58.092919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:58.093372 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:58.094143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:58.094570 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:58.236580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:58.253252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-55853d88-fe78-4463-9a81-b67ffd75df09 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.171638 Jun 15 14:52:58.254194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 147/288] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:58 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:52:59.271534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:52:59.272181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:52:59.279537 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:59.279988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:59.280808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:52:59.281248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:52:59.428978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:52:59.439313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a676ef6-0ed0-4adf-82b0-dcb4d1fd4d3c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.171532 Jun 15 14:52:59.440213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 142/289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:52:59 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:00.457744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:00.458350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:00.465223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:00.465665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:00.466434 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:00.466870 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:00.626568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:00.634769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0721a410-601e-47ee-a4bd-44f8320bfebd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.180863 Jun 15 14:53:00.635606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 148/290] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:00 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:01.653324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:01.654113 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:01.662305 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:01.664240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:01.665052 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:01.665193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:01.818634 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:01.827925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-81af9d4f-d0a7-4c3c-a1ef-04abf3a2a8b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1509 microversion: 2.1 time: 0.178969 Jun 15 14:53:01.828687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 143/291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:01 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:02.846462 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:02.847227 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:02.853769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:02.854318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:02.855094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:02.855530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:03.030098 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:03.038952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6c4ca678-ec67-4726-9979-69073780b2d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1515 microversion: 2.1 time: 0.197188 Jun 15 14:53:03.039690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 149/292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:02 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:07.168829 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-19b46373-4ace-4589-9292-1ff5867f464b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'create', calling method: .version_select at 0x7fb8a8dd6940>, body: {"keypair": {"name": "tempest-keypair-1650655407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv9S3X55tbyKp5EeKdTwohNPxm8lCJ8Dp4SdtWdTkuSZ89NJKYVR3cpwANiCoYAcQmoUQmAeJYKaRjpqpytM/SlyV6UmOJdjq+YlD84af7/VIrhVx2eQQ9mKMyyCjTOwg=="}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:07.189017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-19b46373-4ace-4589-9292-1ff5867f464b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for project b356eba3587e481aa04f99bcb2194b11. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:53:07.193429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-19b46373-4ace-4589-9292-1ff5867f464b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for user ee9df934d1cd461abbf9c3cd90a8fdda and project b356eba3587e481aa04f99bcb2194b11. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:53:07.317499 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-19b46373-4ace-4589-9292-1ff5867f464b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152763 Jun 15 14:53:07.318262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 144/293] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 14:53:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:10.409143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-580798207", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a1346b8-6a67-4edd-802a-fc2458e6df62"}], "security_groups": [{"name": "tempest-securitygroup--112304068"}], "key_name": "tempest-keypair-1650655407", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:10.518392 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] validate_networks() for [('1a1346b8-6a67-4edd-802a-fc2458e6df62', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:53:10.907783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:53:10.908260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:53:10.908763 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:53:10.909205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:53:10.909723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:53:10.919609 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:10.920056 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:10.920902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:10.921324 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:10.939729 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for project b356eba3587e481aa04f99bcb2194b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:53:10.943860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Getting quotas for user ee9df934d1cd461abbf9c3cd90a8fdda and project b356eba3587e481aa04f99bcb2194b11. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:53:10.955128 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:53:10.957428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:53:11.101289 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-00c1830c-3017-40db-88c1-33fc12ea7f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.696380 Jun 15 14:53:11.102648 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 150/294] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:53:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:53:11.113230 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a6dc8b01-8dfa-4a26-84ea-44f3e23c0b3a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:11.113841 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a6dc8b01-8dfa-4a26-84ea-44f3e23c0b3a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:11.192271 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a6dc8b01-8dfa-4a26-84ea-44f3e23c0b3a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:11.208884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a6dc8b01-8dfa-4a26-84ea-44f3e23c0b3a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1245 microversion: 2.1 time: 0.099484 Jun 15 14:53:11.209536 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 145/295] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:11 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:53:12.227028 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:12.227644 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:12.233825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:12.234274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:12.235041 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:12.235477 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:12.302124 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:12.310814 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-76df7a5f-6db1-48dd-a377-64464811c938 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1249 microversion: 2.1 time: 0.088177 Jun 15 14:53:12.311472 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 151/296] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:12 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:13.327752 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:13.328682 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:13.330672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=31 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:13.331801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:13.339515 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:13.339980 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:13.341290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:13.346557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:13.409420 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:13.417374 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-601e2d1a-d1e7-4266-9733-bc3b4b2c3061 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1297 microversion: 2.1 time: 0.093337 Jun 15 14:53:13.417962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 146/297] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:13 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:14.434538 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:14.435154 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:14.443022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:14.443022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:14.443022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:14.443022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:14.561854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:14.571179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9dc36a68-54c6-4114-85ae-3caa7d5e19c7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1303 microversion: 2.1 time: 0.139787 Jun 15 14:53:14.574878 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 152/298] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:14 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:15.589472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:15.590458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:15.597296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:15.597739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:15.598502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:15.598959 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:15.731951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:15.739723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-59766253-85ec-461b-8638-f1adbcea1c43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.155313 Jun 15 14:53:15.740361 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 147/299] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:15 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:16.174615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-7f47efb5-e429-4e9a-a7d5-a864e36d1efd req-f2ef269f-8682-41be-be73-f2ba36c85982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b916fb35-c3eb-4252-9420-c26effc3069f", "tag": "f45bbbcc-04a2-400c-b903-fb83f3b2d61f"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:16.191837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7f47efb5-e429-4e9a-a7d5-a864e36d1efd req-f2ef269f-8682-41be-be73-f2ba36c85982 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.194524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-7f47efb5-e429-4e9a-a7d5-a864e36d1efd req-f2ef269f-8682-41be-be73-f2ba36c85982 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.210052 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-7f47efb5-e429-4e9a-a7d5-a864e36d1efd req-f2ef269f-8682-41be-be73-f2ba36c85982 service nova] Creating event network-changed:f45bbbcc-04a2-400c-b903-fb83f3b2d61f for instance b916fb35-c3eb-4252-9420-c26effc3069f on hv-cinder-78729 Jun 15 14:53:16.225218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-7f47efb5-e429-4e9a-a7d5-a864e36d1efd req-f2ef269f-8682-41be-be73-f2ba36c85982 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055681 Jun 15 14:53:16.227377 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 153/300] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:16.758783 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:16.759314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:16.767113 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.777046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.777046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:16.777046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:16.908843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:16.916444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e74b53f5-1761-4ae4-97b9-8e0dc4649482 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.162557 Jun 15 14:53:16.917024 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 148/301] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:16 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:17.936523 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:17.937174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:17.943982 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:17.944469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:17.945328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:17.945818 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:18.087100 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:18.094451 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-22768897-ba99-46aa-9b93-eac2a70d5226 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.162449 Jun 15 14:53:18.095311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 154/302] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:17 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:19.111534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:19.112216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:19.119123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:19.119574 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:19.120394 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:19.120843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:19.261592 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:19.270663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1f162639-834a-49e6-85a8-1e551aa95794 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.162962 Jun 15 14:53:19.280496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 149/303] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:19 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:20.287103 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:20.287631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:20.294395 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:20.294838 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:20.295591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:20.296025 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:20.432295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:20.440073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1155af76-c137-4f74-9fd5-bbca31acb26d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.156871 Jun 15 14:53:20.440838 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 155/304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:20 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:21.458078 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:21.459315 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:21.461719 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:21.466786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:21.467239 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:21.468016 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:21.468483 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:21.627776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:21.637148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-93c32f64-0d41-4dd8-b554-320635b5644b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.182964 Jun 15 14:53:21.639347 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 150/305] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:21 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:22.656284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:22.656899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:22.658961 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:22.659554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:22.660228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:22.665083 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:22.665993 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:22.666318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:22.666744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:22.804621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:22.813259 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3c89eba8-4346-4b28-a672-7d732e880fca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.160792 Jun 15 14:53:22.813832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 156/306] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:22 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:23.832998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:23.834741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:23.843813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:23.844580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:23.849551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:23.849551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:24.005469 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:24.013797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-273d5219-b82d-4963-a59e-b3d54de94886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.184905 Jun 15 14:53:24.014351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 151/307] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:23 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:53:25.032104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:25.033021 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:25.041768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:25.042897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:25.044254 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:25.044700 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:25.052155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=77 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:25.198252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:25.205860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-afbb885d-c614-4850-a3f4-3ae638743b99 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.178624 Jun 15 14:53:25.206436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 157/308] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:25 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:25.909200 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-dc079a5f-42b6-4d00-8a11-ba2fb2111f46 req-fa19d679-50d4-4813-b19a-4abf07757341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b916fb35-c3eb-4252-9420-c26effc3069f", "name": "network-vif-plugged", "status": "completed", "tag": "f45bbbcc-04a2-400c-b903-fb83f3b2d61f"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:25.918710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-dc079a5f-42b6-4d00-8a11-ba2fb2111f46 req-fa19d679-50d4-4813-b19a-4abf07757341 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:25.919154 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-dc079a5f-42b6-4d00-8a11-ba2fb2111f46 req-fa19d679-50d4-4813-b19a-4abf07757341 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:25.930693 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-dc079a5f-42b6-4d00-8a11-ba2fb2111f46 req-fa19d679-50d4-4813-b19a-4abf07757341 service nova] Creating event network-vif-plugged:f45bbbcc-04a2-400c-b903-fb83f3b2d61f for instance b916fb35-c3eb-4252-9420-c26effc3069f on hv-cinder-78729 Jun 15 14:53:25.936879 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-dc079a5f-42b6-4d00-8a11-ba2fb2111f46 req-fa19d679-50d4-4813-b19a-4abf07757341 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031702 Jun 15 14:53:25.937494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 152/309] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:26.223662 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:26.224389 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:26.231964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:26.232459 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:26.233274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:26.233719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:26.389532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:26.399685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5455cda6-b1d6-4d82-84bb-cbe415ffbdd3 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.180358 Jun 15 14:53:26.409744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 158/310] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:26 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:27.419436 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:27.420412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:27.426843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:27.427300 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:27.428079 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:27.428542 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:27.567064 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:27.575716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9ee7e6da-7724-4c7a-b098-ce4152037b2c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.161170 Jun 15 14:53:27.576332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 153/311] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:27 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:28.593068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:28.593715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:28.601869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:28.607169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:28.607169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:28.607169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:28.773705 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:28.783265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-127ec0c4-a290-443b-8947-c439db813cd6 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1370 microversion: 2.1 time: 0.194305 Jun 15 14:53:28.783906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 159/312] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:28 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:29.801245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:29.801870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:29.809715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:29.810177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:29.811016 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:29.811474 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:29.951144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:29.959577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-487848ab-b216-4427-bc4d-487f648e1e82 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1564 microversion: 2.1 time: 0.161786 Jun 15 14:53:29.959873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 154/313] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:29 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:29.977785 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d1a4cab6-5a70-4124-99b1-9ae472cb2798 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:29.978463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d1a4cab6-5a70-4124-99b1-9ae472cb2798 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:29.984838 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a4cab6-5a70-4124-99b1-9ae472cb2798 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:29.985282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a4cab6-5a70-4124-99b1-9ae472cb2798 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:29.987463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a4cab6-5a70-4124-99b1-9ae472cb2798 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:29.987463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a4cab6-5a70-4124-99b1-9ae472cb2798 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:30.070374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d1a4cab6-5a70-4124-99b1-9ae472cb2798 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097373 Jun 15 14:53:30.071068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 160/314] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 14:53:29 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:31.166086 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-67ddf12a-815c-407b-be5a-28a1c8d6660d req-76d4af0d-f364-4717-80d6-e2263a8e2fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b916fb35-c3eb-4252-9420-c26effc3069f", "tag": "f45bbbcc-04a2-400c-b903-fb83f3b2d61f"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:31.175649 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-67ddf12a-815c-407b-be5a-28a1c8d6660d req-76d4af0d-f364-4717-80d6-e2263a8e2fcf service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:31.176206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-67ddf12a-815c-407b-be5a-28a1c8d6660d req-76d4af0d-f364-4717-80d6-e2263a8e2fcf service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:31.191778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-67ddf12a-815c-407b-be5a-28a1c8d6660d req-76d4af0d-f364-4717-80d6-e2263a8e2fcf service nova] Creating event network-changed:f45bbbcc-04a2-400c-b903-fb83f3b2d61f for instance b916fb35-c3eb-4252-9420-c26effc3069f on hv-cinder-78729 Jun 15 14:53:31.199800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-67ddf12a-815c-407b-be5a-28a1c8d6660d req-76d4af0d-f364-4717-80d6-e2263a8e2fcf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040062 Jun 15 14:53:31.201400 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 155/315] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:32.093849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:53:32.094023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 14:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:53:45.456039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=9 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:45.456904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=21 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:45.460797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1787794937", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:45.529237 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] validate_networks() for None {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:53:45.905913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:53:45.906417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:53:45.906891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:53:45.907305 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:53:45.907722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:53:45.920318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:45.920999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:45.921973 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:45.922576 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:45.944502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Getting quotas for project 2addbe652f344f1583f0198fbd62864d. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:53:45.950218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Getting quotas for user be81f5426d684c95b21bf45ffbca87a2 and project 2addbe652f344f1583f0198fbd62864d. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:53:45.962596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:53:45.965115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:53:46.108475 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-95bccfde-ddec-4101-8632-ca0ccef7bf84 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653133 Jun 15 14:53:46.109380 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 161/316] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:53:46.118425 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=19 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:46.119196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=52 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:46.124495 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0d470a48-2980-49d4-a3c1-7474b8bfa111 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:46.125223 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0d470a48-2980-49d4-a3c1-7474b8bfa111 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:46.197652 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0d470a48-2980-49d4-a3c1-7474b8bfa111 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:46.205671 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0d470a48-2980-49d4-a3c1-7474b8bfa111 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1215 microversion: 2.1 time: 0.089361 Jun 15 14:53:46.206853 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 156/317] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:46 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:47.224530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a64c32dc-57bd-4c86-8ed1-11a978b20642 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:47.225673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a64c32dc-57bd-4c86-8ed1-11a978b20642 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:47.293443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a64c32dc-57bd-4c86-8ed1-11a978b20642 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:47.300607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a64c32dc-57bd-4c86-8ed1-11a978b20642 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1215 microversion: 2.1 time: 0.081245 Jun 15 14:53:47.301220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 162/318] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:47 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:48.318385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:48.319303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:48.327589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:48.328033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:48.329012 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:48.329443 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:48.399359 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:48.406967 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-551089b9-42c5-49b0-8738-88360a02ebe2 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1267 microversion: 2.1 time: 0.092715 Jun 15 14:53:48.407544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 157/319] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:48 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:49.431739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:49.433270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:49.442150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:49.443594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:49.445282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:49.446012 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:49.528875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:49.536757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-af85a2be-21c7-4e3d-baf9-3c02c4c70bd5 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1273 microversion: 2.1 time: 0.109074 Jun 15 14:53:49.537791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 163/320] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:49 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:50.560474 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:50.561099 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:50.578218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:50.578663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:50.579454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:50.579892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:50.803184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:50.815026 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0f53e620-b82d-43ef-be1f-c5365dfa2663 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.259419 Jun 15 14:53:50.825661 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 158/321] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:50 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:51.834110 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:51.835326 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:51.846745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:51.850147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:51.851576 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:51.852671 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:52.005865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-d365ab4d-4aeb-4dab-8e26-a43a136ef4cb req-9db3b9b3-d4df-49f7-bf03-f57edc0447de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345d3e9b-34b5-4200-8e2b-17b3183d4efe", "tag": "02d6b571-8955-42c2-b5ba-e76417d45e5e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:52.019134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-d365ab4d-4aeb-4dab-8e26-a43a136ef4cb req-9db3b9b3-d4df-49f7-bf03-f57edc0447de service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:52.025281 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-d365ab4d-4aeb-4dab-8e26-a43a136ef4cb req-9db3b9b3-d4df-49f7-bf03-f57edc0447de service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:52.085573 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-d365ab4d-4aeb-4dab-8e26-a43a136ef4cb req-9db3b9b3-d4df-49f7-bf03-f57edc0447de service nova] Creating event network-changed:02d6b571-8955-42c2-b5ba-e76417d45e5e for instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe on hv-cinder-78729 Jun 15 14:53:52.097314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-d365ab4d-4aeb-4dab-8e26-a43a136ef4cb req-9db3b9b3-d4df-49f7-bf03-f57edc0447de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095023 Jun 15 14:53:52.100921 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 159/322] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:53:52.242332 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:52.261762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9c029e7c-31b3-4c28-a90a-031751577db4 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.432709 Jun 15 14:53:52.271454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 164/323] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:51 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:53.281527 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:53.283168 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:53.292953 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:53.293439 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:53.294267 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:53.294718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:53.482154 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:53.492999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b2ba5c0c-2288-453b-b164-4d259776be1f tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.216362 Jun 15 14:53:53.493780 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 160/324] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:53 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:54.515022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:54.515881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:54.519731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1c8a25d9-30ac-484f-9fb8-0668c7e009ab tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:54.520462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1c8a25d9-30ac-484f-9fb8-0668c7e009ab tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:54.526889 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:54.527656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:54.529340 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:54.530149 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:54.540690 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c8a25d9-30ac-484f-9fb8-0668c7e009ab tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:54.544884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c8a25d9-30ac-484f-9fb8-0668c7e009ab tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:54.546129 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c8a25d9-30ac-484f-9fb8-0668c7e009ab tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:54.548661 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1c8a25d9-30ac-484f-9fb8-0668c7e009ab tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:54.591837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1c8a25d9-30ac-484f-9fb8-0668c7e009ab tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/ips" status: 200 len: 146 microversion: 2.1 time: 0.076090 Jun 15 14:53:54.598374 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 161/325] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 14:53:54 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/ips => generated 146 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:54.736484 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:54.753865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e758f0af-59c0-439e-9faf-9aba0e45f52d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.246793 Jun 15 14:53:54.754797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 165/326] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:54 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:55.031746 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a41704df-6181-4c35-a6ec-e2961287d49f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Action: 'create', calling method: .version_select at 0x7fb8a8d504c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1231359926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU2ObAvDkmD/U1CxiuG2zlcAXxTGu0yfViOdqbP+THqoWn4DJzD1JekUrRl5Oog8yWrjciTVRhq4eLG1lrWMJFfC85NamJ4CCDmBDzmJ+Hd1TKkt8AQfTwE/47dVLgOrg=="}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:55.048657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-a41704df-6181-4c35-a6ec-e2961287d49f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Getting quotas for project f3340f5c4bac49cfaaaa0d80b1bfbb4a. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:53:55.053229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-a41704df-6181-4c35-a6ec-e2961287d49f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Getting quotas for user a0e682af1a7f493c992509142b673932 and project f3340f5c4bac49cfaaaa0d80b1bfbb4a. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:53:55.144179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a41704df-6181-4c35-a6ec-e2961287d49f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.347591 Jun 15 14:53:55.144780 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 162/327] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 14:53:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:55.776402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:55.778394 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:55.787669 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:55.788500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:55.789564 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:55.790086 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:55.929676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:56.047680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:56.071887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-48067681-e36a-487b-8402-b413a9ebc0eb tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.293759 Jun 15 14:53:56.075434 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 166/328] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:55 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:57.099175 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:57.099175 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:57.103643 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:57.104401 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:57.105446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:57.106258 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:57.287677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:57.297697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ead1d68f-a6d0-4b72-8817-dbce4109394e tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.206763 Jun 15 14:53:57.297697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 163/329] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:57 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:58.314904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:58.315502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:58.321407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=8 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:58.323639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:58.324187 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:58.324921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:58.325363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:58.499687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:58.509112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5b52aabc-928e-4730-b697-d18f975a3c12 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.197740 Jun 15 14:53:58.519574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 167/330] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:58 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:59.097184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8589b052-e8f5-4934-b494-de7c8554c7d8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71e626ea-5fc9-4c9b-ac78-4dc72dd068b0"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:53:59.098974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8589b052-e8f5-4934-b494-de7c8554c7d8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:59.106056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8589b052-e8f5-4934-b494-de7c8554c7d8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:59.106507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8589b052-e8f5-4934-b494-de7c8554c7d8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:59.107490 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8589b052-e8f5-4934-b494-de7c8554c7d8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:59.108128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8589b052-e8f5-4934-b494-de7c8554c7d8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:59.526683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:59.527288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:53:59.533789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:59.538038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:59.538038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:59.538038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:59.675240 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:53:59.689295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8d14fd58-6037-4159-bacb-9f038da52237 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.166358 Jun 15 14:53:59.689988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 168/331] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:53:59 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:00.033187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8589b052-e8f5-4934-b494-de7c8554c7d8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939911 Jun 15 14:54:00.033819 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 164/332] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 14:53:59 2022] POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:00.708781 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:00.709420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:00.716561 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:00.720494 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:00.720494 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:00.720494 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:00.780840 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-a89a8e02-b9d2-4c89-b8ab-2a0f34c6978d req-95a79d54-ed84-4a6a-a4f4-09199b736d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345d3e9b-34b5-4200-8e2b-17b3183d4efe", "name": "network-vif-plugged", "status": "completed", "tag": "02d6b571-8955-42c2-b5ba-e76417d45e5e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:00.790768 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-a89a8e02-b9d2-4c89-b8ab-2a0f34c6978d req-95a79d54-ed84-4a6a-a4f4-09199b736d8c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:00.791319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-a89a8e02-b9d2-4c89-b8ab-2a0f34c6978d req-95a79d54-ed84-4a6a-a4f4-09199b736d8c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:00.804310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-a89a8e02-b9d2-4c89-b8ab-2a0f34c6978d req-95a79d54-ed84-4a6a-a4f4-09199b736d8c service nova] Creating event network-vif-plugged:02d6b571-8955-42c2-b5ba-e76417d45e5e for instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe on hv-cinder-78729 Jun 15 14:54:00.812696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-a89a8e02-b9d2-4c89-b8ab-2a0f34c6978d req-95a79d54-ed84-4a6a-a4f4-09199b736d8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037554 Jun 15 14:54:00.813606 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 165/333] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:54:00.863727 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:00.867581 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-28892754-a01c-4688-9c0a-5b3e153e7788 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.163159 Jun 15 14:54:00.868183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 169/334] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:00 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:01.886621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:01.887361 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:01.898859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:01.898859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:01.898859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:01.898859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:02.038997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:02.046647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7d7b343a-02a1-401d-b01a-bd838e16947a tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.165449 Jun 15 14:54:02.047228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 166/335] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:01 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:03.063195 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:03.063828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:03.069985 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:03.070431 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:03.071183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:03.071754 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:03.204997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:03.214400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9a2524a5-3a19-414f-99d7-8f2d2f55a4cc tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1315 microversion: 2.1 time: 0.154522 Jun 15 14:54:03.215064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 170/336] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:03 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:04.233802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:04.234374 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:04.241621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:04.242070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:04.242857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:04.243324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:04.391272 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:04.399991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ab15a78b-dbdc-4941-9cb8-9bf355f22865 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1464 microversion: 2.1 time: 0.170655 Jun 15 14:54:04.401121 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 167/337] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:04 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:04.447084 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:04.451189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:04.454670 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:04.455116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:04.455900 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:04.456491 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:04.483506 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:54:04.756265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b30a1f1c-cfac-41d4-8da3-385f98162e86 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "DELETE /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 204 len: 0 microversion: 2.1 time: 0.312769 Jun 15 14:54:04.756861 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 171/338] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:54:04 2022] DELETE /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:54:04.765509 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:04.766124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:04.772488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:04.773028 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:04.773720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:04.774160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:04.914638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:04.922704 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-04f80d10-f990-45e5-a21f-68ea32bca8e1 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1470 microversion: 2.1 time: 0.161165 Jun 15 14:54:04.923298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 168/339] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:04 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:05.941097 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:05.941810 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:05.948638 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:05.949099 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:05.949891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:05.950335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:06.111003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:06.118932 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ccd5ad83-76dc-4596-96a4-e06d7919435d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1470 microversion: 2.1 time: 0.182432 Jun 15 14:54:06.119509 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 172/340] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:05 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:07.137002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:07.137600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:07.139585 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:07.145094 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:07.145546 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:07.146318 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:07.146799 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:07.290847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:07.301215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b6de2aa6-98c6-471e-8c3c-fe9df685e223 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1470 microversion: 2.1 time: 0.167408 Jun 15 14:54:07.301215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 169/341] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:07 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:08.318663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:08.319301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:08.326498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:08.326955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:08.327742 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:08.328215 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:08.462133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:08.470130 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f61d5ca3-8200-4265-8377-8d6c2f5d4a28 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1470 microversion: 2.1 time: 0.155444 Jun 15 14:54:08.470707 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 173/342] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:08 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:09.038750 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-ff22abfc-50a3-46e0-b314-bb5f8a68c434 req-7148e0d1-a73f-41c7-9d4f-398e5f160f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345d3e9b-34b5-4200-8e2b-17b3183d4efe", "name": "network-vif-deleted", "tag": "02d6b571-8955-42c2-b5ba-e76417d45e5e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:09.048758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-ff22abfc-50a3-46e0-b314-bb5f8a68c434 req-7148e0d1-a73f-41c7-9d4f-398e5f160f32 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:09.049258 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-ff22abfc-50a3-46e0-b314-bb5f8a68c434 req-7148e0d1-a73f-41c7-9d4f-398e5f160f32 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:09.064891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-ff22abfc-50a3-46e0-b314-bb5f8a68c434 req-7148e0d1-a73f-41c7-9d4f-398e5f160f32 service nova] Creating event network-vif-deleted:02d6b571-8955-42c2-b5ba-e76417d45e5e for instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe on hv-cinder-78729 Jun 15 14:54:09.070509 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-ff22abfc-50a3-46e0-b314-bb5f8a68c434 req-7148e0d1-a73f-41c7-9d4f-398e5f160f32 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036170 Jun 15 14:54:09.071079 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 170/343] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:09.489345 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:09.489951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:09.496062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:09.496539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:09.497306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:09.497743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:09.565432 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:09.573875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f75b58db-3653-4a74-bca6-9a11ffb11ee3 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1300 microversion: 2.1 time: 0.087800 Jun 15 14:54:09.574674 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 174/344] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:09 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:09.757988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f9640220-ceda-4e74-813d-4364299f5ade tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:09.765390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f9640220-ceda-4e74-813d-4364299f5ade tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:09.765849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f9640220-ceda-4e74-813d-4364299f5ade tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:09.838477 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f9640220-ceda-4e74-813d-4364299f5ade tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Going to try to stop instance {{(pid=124660) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 14:54:10.079544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f9640220-ceda-4e74-813d-4364299f5ade tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action" status: 202 len: 0 microversion: 2.1 time: 0.325651 Jun 15 14:54:10.080262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 171/345] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:54:09 2022] POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:54:10.088377 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:10.089011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:10.095227 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:10.095673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:10.096474 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:10.096898 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:10.470524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:10.479843 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bf633838-5c1a-424f-b708-60c705f385c8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.394702 Jun 15 14:54:10.480445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 175/346] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:10 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:10.592212 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:10.593152 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:10.599946 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:10.604910 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:10.604910 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:10.604910 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:10.635661 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:10.636128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:10.636776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lazy-loading 'fault' on Instance uuid 345d3e9b-34b5-4200-8e2b-17b3183d4efe {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:10.681906 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be81f5426d684c95b21bf45ffbca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2addbe652f344f1583f0198fbd62864d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:10.689739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-12182198-ac92-4a06-911f-d0b78d975863 tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 200 len: 1305 microversion: 2.1 time: 0.102706 Jun 15 14:54:10.690609 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 172/347] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:10 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:11.497617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:11.498180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:11.504471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:11.504922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:11.505846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:11.506381 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:11.652266 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:11.661155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ee7625e9-f158-4084-b606-6e0c4c031e45 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.167904 Jun 15 14:54:11.661998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 176/348] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:11 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:11.707007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:11.708284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] [instance: 345d3e9b-34b5-4200-8e2b-17b3183d4efe] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:11.714701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:11.715157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:11.715936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:11.716408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:11.730304 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] HTTP exception thrown: Instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe could not be found. Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Request method failure captured: Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe HTTP/1.1 Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfJ2JWu17wt_JpWtD1SH93GmoiA9Jk1lutWXgA5m2Po8OWqKwJZan45lvcq4QLQ1D5ZoxT_efr9l3rs6NA73z8Fd-AB_Enup22sxWYN-5e3605HrvekzFwgQscsqsZPj_H_AviiYpRXEmV37V2yBKBHzrkOlYsuC-YUYD4ponFCro-0 Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 2addbe652f344f1583f0198fbd62864d Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesNegativeTest-707156365 Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:54:11.731930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2addbe652f344f1583f0198fbd62864d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2addbe652f344f1583f0198fbd62864d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2addbe652f344f1583f0198fbd62864d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2addbe652f344f1583f0198fbd62864d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesNegativeTest-707156365 Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 2addbe652f344f1583f0198fbd62864d Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesNegativeTest-707156365 Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesNegativeTest-707156365-project Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: be81f5426d684c95b21bf45ffbca87a2 Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesNegativeTest-707156365-project Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe could not be found. Jun 15 14:54:11.733540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '345d3e9b-34b5-4200-8e2b-17b3183d4efe'} Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe could not be found. Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:54:11.734485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe could not be found. Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe could not be found. Jun 15 14:54:11.735897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:54:11.737209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] Returning 404 to user: Instance 345d3e9b-34b5-4200-8e2b-17b3183d4efe could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:54:11.737209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1493bba5-38dd-451a-b916-f1966017f20d tempest-VolumesNegativeTest-707156365 tempest-VolumesNegativeTest-707156365-project] 10.222.0.42 "GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe" status: 404 len: 111 microversion: 2.1 time: 0.030519 Jun 15 14:54:11.737209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 173/349] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:11 2022] GET /compute/v2.1/servers/345d3e9b-34b5-4200-8e2b-17b3183d4efe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:54:12.679080 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:12.679828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:12.686275 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:12.686719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:12.687530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:12.687993 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:12.709869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:12.834886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:12.843402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-80c23ca0-4089-464d-84ca-bc394955bea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.168281 Jun 15 14:54:12.844031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 177/350] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:12 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:13.862639 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:13.863395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:13.870238 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:13.870702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:13.871723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:13.872208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:14.019490 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:14.023220 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:14.029441 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a6b22fea-2046-453a-ad2d-d3f398d5f0ad tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.170609 Jun 15 14:54:14.030022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 174/351] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:13 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:15.048371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:15.048998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:15.055769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:15.056316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:15.057108 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:15.062426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:15.198020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:15.206946 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3b70ef8c-55ec-4ba1-bf9a-4acdb17a96be tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.162928 Jun 15 14:54:15.207526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 178/352] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:15 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:16.226090 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:16.226709 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:16.235087 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:16.235566 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:16.236726 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:16.237218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:16.389900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:16.401997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0e55acd2-5698-4ca4-a763-35800b473584 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.180589 Jun 15 14:54:16.402633 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 175/353] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:16 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:17.420396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:17.421066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:17.423128 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:17.428542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:17.428913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:17.429683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:17.430122 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:17.587253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:17.596584 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c3342d60-a4d5-431a-b155-1d73696dce1c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.180414 Jun 15 14:54:17.597156 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 179/354] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:17 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:18.614368 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:18.614983 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:18.617875 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:18.623308 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:18.623694 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:18.624764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:18.625208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:18.765503 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:18.773934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ccd56b7e-4b28-49db-abdd-ec391f372fa4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.163660 Jun 15 14:54:18.774507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 176/355] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:18 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:19.793638 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:19.794268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:19.800722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:19.801184 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:19.801983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:19.802422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:19.937888 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:19.946381 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bbd8d61e-cfe9-4b46-b07b-5e88d3cc8d2c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.157887 Jun 15 14:54:19.947318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 180/356] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:19 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:20.964157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:20.964856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:20.972767 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:20.973223 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:20.974014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:20.974455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:21.123417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:21.132206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1de0463a-2046-4bf5-a0d2-eda8aa16adb1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.172301 Jun 15 14:54:21.140801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 177/357] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:20 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:22.151629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:22.152276 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:22.161835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:22.162274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:22.163043 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:22.163479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:22.322825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:22.336661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-06c76251-26ba-4cd9-aa96-d0558a70fa08 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.188509 Jun 15 14:54:22.344770 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 181/358] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:22 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:23.364664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:23.367516 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:23.379866 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:23.381014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:23.382617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:23.383791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:23.643063 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:23.656950 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f656bfe5-5b08-4dd5-a300-56ecd017acae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.296770 Jun 15 14:54:23.657825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 178/359] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:23 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:24.682829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:24.683385 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:24.691072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:24.691527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:24.692364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:24.692924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:24.971910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:24.981279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-69030076-bdbf-43a3-a82f-25080092a464 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.303559 Jun 15 14:54:24.982211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 182/360] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:24 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:25.999336 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:26.000116 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:26.009158 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:26.009768 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:26.010790 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:26.011350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:26.214222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:26.226488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b8c2ac31-45af-4f92-b66a-c35fb5715744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1724 microversion: 2.1 time: 0.230974 Jun 15 14:54:26.227161 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 179/361] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:25 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:27.247507 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:27.248389 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:27.256918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:27.257566 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:27.258750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:27.259402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:27.495487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:27.505271 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-59edd14c-ed25-479f-b85b-8d9fd63cc0d6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1701 microversion: 2.1 time: 0.263092 Jun 15 14:54:27.506035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 183/362] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:27 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1701 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:27.524445 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-26ed6275-c931-44e0-a6c0-ed1132ddf15e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:27.533784 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-26ed6275-c931-44e0-a6c0-ed1132ddf15e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:27.534481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-26ed6275-c931-44e0-a6c0-ed1132ddf15e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:27.566357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-26ed6275-c931-44e0-a6c0-ed1132ddf15e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Going to try to start instance {{(pid=124660) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 14:54:27.867854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1889031308", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1231359926", "security_groups": [{"name": "tempest-secgroup-smoke-472278871"}], "networks": [{"uuid": "017cd3b5-a353-4ee3-8749-de198d664be1"}], "block_device_mapping_v2": [{"uuid": "3942d389-4881-461b-908f-a185cf39bb09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:27.897890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-26ed6275-c931-44e0-a6c0-ed1132ddf15e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action" status: 202 len: 0 microversion: 2.1 time: 0.377347 Jun 15 14:54:27.898716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 180/363] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:54:27 2022] POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:54:27.916944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:27.918163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:27.929354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:27.930299 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:27.931877 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:27.932901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:28.154766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] validate_networks() for [('017cd3b5-a353-4ee3-8749-de198d664be1', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:54:28.322637 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:28.335981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b301dab5-3800-4011-a869-032a77e7cba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1710 microversion: 2.1 time: 0.428531 Jun 15 14:54:28.341384 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 181/364] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:27 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1710 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:29.329633 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:54:29.330832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:54:29.331538 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:54:29.332482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:54:29.333267 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:54:29.345393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:29.346022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:29.347162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:29.347909 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:29.367491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:29.372028 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:29.377138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Getting quotas for project f3340f5c4bac49cfaaaa0d80b1bfbb4a. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:29.382408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Getting quotas for user a0e682af1a7f493c992509142b673932 and project f3340f5c4bac49cfaaaa0d80b1bfbb4a. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:29.405263 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:29.406033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:29.412620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:29.413514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:29.502948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:54:29.505242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3942d389-4881-461b-908f-a185cf39bb09',volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:54:29.758636 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:29.772157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ca9d4b27-5f26-4e9c-8f8f-d8f455621726 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1710 microversion: 2.1 time: 0.413171 Jun 15 14:54:29.786195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 182/365] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:29 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1710 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:30.141343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ca19a0e2-dcd6-411e-a0a0-befae873ca15 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.287905 Jun 15 14:54:30.150051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 184/366] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:54:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 2290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:54:30.156075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-154c1da8-9ff2-4095-80f8-ca3d9ea94b42 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:30.156794 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-154c1da8-9ff2-4095-80f8-ca3d9ea94b42 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:30.247472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-154c1da8-9ff2-4095-80f8-ca3d9ea94b42 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:30.257011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-154c1da8-9ff2-4095-80f8-ca3d9ea94b42 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1089 microversion: 2.1 time: 0.105331 Jun 15 14:54:30.258425 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 183/367] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:30 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1089 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:30.802677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:30.803338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:30.812828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:30.813309 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:30.814160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:30.814606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:31.031436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:31.045731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d1a9d012-8794-4a6f-add4-8163a7769483 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1710 microversion: 2.1 time: 0.245582 Jun 15 14:54:31.046762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 185/368] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:30 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1710 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:31.275693 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-af9e01a2-e804-4568-8033-ba421bf90ce6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:31.276498 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-af9e01a2-e804-4568-8033-ba421bf90ce6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:31.334499 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af9e01a2-e804-4568-8033-ba421bf90ce6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:31.349481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-af9e01a2-e804-4568-8033-ba421bf90ce6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1089 microversion: 2.1 time: 0.077830 Jun 15 14:54:31.350069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 184/369] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:31 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:32.064671 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:32.066022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:32.073077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:32.074205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:32.076223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:32.077323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:32.320133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:32.332328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-08c175be-dd90-408b-8565-13defb79ab1d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1714 microversion: 2.1 time: 0.271150 Jun 15 14:54:32.350560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 186/370] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:32 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1714 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:32.376607 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:32.377821 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:32.390208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:32.391027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:32.392451 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:32.393330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:32.505786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:32.518592 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-25395f5d-812d-4e5f-9cb2-c34ddd131951 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1131 microversion: 2.1 time: 0.149456 Jun 15 14:54:32.520113 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 185/371] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:32 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1131 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:33.540075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:33.541610 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:33.551853 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:33.552933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:33.554645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:33.555350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:33.642082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:33.656123 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8d402808-76e4-4b6a-a277-40d32ef4d866 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1205 microversion: 2.1 time: 0.121666 Jun 15 14:54:33.656833 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 187/372] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:33 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1205 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:34.674638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:34.675367 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:34.686511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:34.686511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:34.686511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:34.686511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:34.928241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:34.937415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c17710bc-6a1a-4048-81bc-1a2ffef3e40d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1272 microversion: 2.1 time: 0.267167 Jun 15 14:54:34.938159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 186/373] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:34 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:35.956352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:35.958696 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:35.969677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:35.970739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:35.971708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:35.972565 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:36.223715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-4cd7d1b7-2444-412b-a1c4-ee51e976aff9 req-e58fd5c8-b80b-4c1e-8cc4-4538b936df37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5cf910-fe77-4ed2-9851-6b5a45f93c80", "tag": "5b0dddd1-2896-4186-9fd4-38e802bca5a6"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:36.245031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-4cd7d1b7-2444-412b-a1c4-ee51e976aff9 req-e58fd5c8-b80b-4c1e-8cc4-4538b936df37 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:36.245558 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-4cd7d1b7-2444-412b-a1c4-ee51e976aff9 req-e58fd5c8-b80b-4c1e-8cc4-4538b936df37 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:36.276846 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-4cd7d1b7-2444-412b-a1c4-ee51e976aff9 req-e58fd5c8-b80b-4c1e-8cc4-4538b936df37 service nova] Creating event network-changed:5b0dddd1-2896-4186-9fd4-38e802bca5a6 for instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 on hv-cinder-78729 Jun 15 14:54:36.287689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-4cd7d1b7-2444-412b-a1c4-ee51e976aff9 req-e58fd5c8-b80b-4c1e-8cc4-4538b936df37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069493 Jun 15 14:54:36.289133 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 187/374] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:36.337860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:36.349077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c1200ba1-3ee2-4938-aec4-6390679705eb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.397545 Jun 15 14:54:36.350031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 188/375] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:35 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:37.367815 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:37.368572 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:37.375364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.378298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.378298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:37.378298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:37.695613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:37.711952 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4c8c6726-2522-4578-abc7-9c01cf4407d5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.341646 Jun 15 14:54:37.714698 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 188/376] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:37 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:38.752949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:38.753554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:38.760712 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.761747 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.762795 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:38.763238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:38.922393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:38.930368 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2e2a459a-1d0d-427c-b6db-fe724c9628cb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.205185 Jun 15 14:54:38.930957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 189/377] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:38 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:39.948144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:39.949544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:39.960970 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:39.961416 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:39.962405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:39.963000 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:40.167042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:40.178242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7f7c4271-e7b8-4bd0-beed-015df975be1c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.233084 Jun 15 14:54:40.186646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 189/378] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:39 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:41.198820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:41.200751 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:41.202684 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:41.203374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:41.208731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:41.209573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:41.211106 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:41.211719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:41.406989 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:41.425286 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-faf1015a-0fb7-4e38-869f-4febd214531a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.230178 Jun 15 14:54:41.443265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 190/379] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:41 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:42.452691 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:42.453298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:42.455938 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=4 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:42.460816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.461260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:42.462104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:42.462706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:42.628016 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:42.644674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-61e12876-ac00-48c6-8b9e-34f6fe07ee24 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.199141 Jun 15 14:54:42.645246 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 190/380] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:42 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:43.667049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:43.668308 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:43.676344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:43.676344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:43.676344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:43.676344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:43.828029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:43.836738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-587121d0-aad9-4a20-861d-eca368d4ecbb tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.173618 Jun 15 14:54:43.846653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 191/381] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:43 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:44.854377 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:44.856133 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:44.868378 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:44.868860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:44.869657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:44.870096 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:45.029753 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:45.038060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-da332509-d7ac-4575-b380-e3705f36a6bc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.187424 Jun 15 14:54:45.048334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 191/382] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:44 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:46.055210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:46.056112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:46.062429 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.062885 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.063709 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:46.064172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:46.067705 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=83 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:46.223299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:46.233729 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-32f64d03-0dac-4635-83d7-e16ee141dfaa tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.182115 Jun 15 14:54:46.234373 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 192/383] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:46 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:46.806487 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-be6a5e20-2660-48a9-85fe-c47af6865831 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Action: 'create', calling method: .version_select at 0x7fb8a8f1a4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1150452139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMh2UVYMTwPNO/vzb3KHy+/QPLMhckfzjTVYVd0B+dF3sF5CBAlCxrYX1tXqaMY6eiEENylfg6i7R+hGXpP8na4uNo57bD2RMeoF0QicCDiR8K0bcLZeFQBh8RUC0WwlA=="}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:46.821159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-be6a5e20-2660-48a9-85fe-c47af6865831 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Getting quotas for project 7a96a40d9feb40b8bbc143f1f9be7408. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:46.829456 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-be6a5e20-2660-48a9-85fe-c47af6865831 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Getting quotas for user 8a8c023cd5014daa993be2735b1c05ab and project 7a96a40d9feb40b8bbc143f1f9be7408. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:46.907737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-be6a5e20-2660-48a9-85fe-c47af6865831 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.104789 Jun 15 14:54:46.908805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 192/384] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 14:54:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:54:46.964681 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-116019100", "imageRef": "9278daad-b97f-49bd-89f2-738152a9e0b2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1150452139", "networks": [{"uuid": "bb2ad87e-460e-4587-a358-7360e8ecddf0"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:47.034574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] validate_networks() for [('bb2ad87e-460e-4587-a358-7360e8ecddf0', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:54:47.253149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:47.254285 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:47.263738 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.264340 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.265493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.265963 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.272585 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:47.520828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:47.529169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c0eab513-b54f-44c3-8dc8-0f2857b50a4d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.281068 Jun 15 14:54:47.529761 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 193/385] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:47 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:47.555544 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:54:47.556070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:54:47.556764 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:54:47.556938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:54:47.557357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:54:47.569613 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.569613 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.570278 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:47.570718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:47.592133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Getting quotas for project 7a96a40d9feb40b8bbc143f1f9be7408. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:54:47.597335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Getting quotas for user 8a8c023cd5014daa993be2735b1c05ab and project 7a96a40d9feb40b8bbc143f1f9be7408. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:54:47.612604 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:54:47.614851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9278daad-b97f-49bd-89f2-738152a9e0b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:54:47.789318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d0224161-c223-4694-a08b-ceadd6c1b079 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828571 Jun 15 14:54:47.790016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 193/386] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:54:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:54:47.801481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-66993a78-4bdb-45a8-a0c2-480c32c11882 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:47.802095 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-66993a78-4bdb-45a8-a0c2-480c32c11882 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:47.865365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-66993a78-4bdb-45a8-a0c2-480c32c11882 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:47.876467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-66993a78-4bdb-45a8-a0c2-480c32c11882 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1258 microversion: 2.1 time: 0.079728 Jun 15 14:54:47.883658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 194/387] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:47 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:48.547211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:48.547828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:48.557398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.557398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.560687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:48.561153 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:48.732860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:48.741491 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec53e37f-14f2-49aa-86c1-8a4d015d95bd tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.198829 Jun 15 14:54:48.742075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 194/388] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:48 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:48.895650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3268a2aa-951f-4679-b6eb-bc2e6822c653 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:48.896236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3268a2aa-951f-4679-b6eb-bc2e6822c653 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:48.956946 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3268a2aa-951f-4679-b6eb-bc2e6822c653 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:48.965920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3268a2aa-951f-4679-b6eb-bc2e6822c653 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1258 microversion: 2.1 time: 0.074325 Jun 15 14:54:48.966516 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 195/389] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:48 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:49.759355 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:49.760001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:49.766514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.766970 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.767763 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.768198 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.910109 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:49.918897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8ac9f6dc-c0ae-4cbc-a0dd-6c11b6f2dcb9 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.163748 Jun 15 14:54:49.919467 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 195/390] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:49 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:49.984691 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:49.985297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:49.992011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.992495 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:49.993258 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:49.993688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.056433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:50.065083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b8b2b919-0cd6-48c9-bad4-8534978c9862 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1262 microversion: 2.1 time: 0.085341 Jun 15 14:54:50.065705 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 196/391] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:49 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:50.121001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-a46fa2df-f138-4962-819f-04023122bff3 req-8f661a5e-0f8c-4694-903f-077ef77d51ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5cf910-fe77-4ed2-9851-6b5a45f93c80", "name": "network-vif-plugged", "status": "completed", "tag": "5b0dddd1-2896-4186-9fd4-38e802bca5a6"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:50.124531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:50.130367 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a46fa2df-f138-4962-819f-04023122bff3 req-8f661a5e-0f8c-4694-903f-077ef77d51ba service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.130808 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a46fa2df-f138-4962-819f-04023122bff3 req-8f661a5e-0f8c-4694-903f-077ef77d51ba service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.142307 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-a46fa2df-f138-4962-819f-04023122bff3 req-8f661a5e-0f8c-4694-903f-077ef77d51ba service nova] Creating event network-vif-plugged:5b0dddd1-2896-4186-9fd4-38e802bca5a6 for instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 on hv-cinder-78729 Jun 15 14:54:50.147453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-a46fa2df-f138-4962-819f-04023122bff3 req-8f661a5e-0f8c-4694-903f-077ef77d51ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 Jun 15 14:54:50.148039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 196/392] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:50.936962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:50.937510 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:50.943687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.944180 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.944957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.945392 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.082793 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:51.083933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:51.087386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:51.092487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.092938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.093931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:51.094776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:51.095885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e6035034-1e08-4051-bbe5-ba9fa3ce5c90 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.163902 Jun 15 14:54:51.096493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 197/393] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:50 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:51.162454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:51.171001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-47965dbb-b357-4a5d-b518-2170017c9aa6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1310 microversion: 2.1 time: 0.092433 Jun 15 14:54:51.171766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 197/394] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:51 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:52.113136 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:52.113677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:52.116135 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:52.121998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.122438 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.123217 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.123649 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.188731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:52.189363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:52.196661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.197185 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.197997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:52.199037 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:52.286232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:52.298934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-beb121fc-80c4-4cf2-84f9-ffdde79c3222 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.114058 Jun 15 14:54:52.299994 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 198/395] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:52 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1318 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:52.303637 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:52.312810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7df21293-4ca0-459a-a54d-cfb7ea483052 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.203627 Jun 15 14:54:52.313404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 198/396] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:52 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:53.318985 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:53.320031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:53.330183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.330663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.331836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.332035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:53.332501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.332936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:53.341298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.341724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.342799 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:53.343236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:53.418601 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:53.427253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-437119f1-0299-471a-813f-50ccd6ef27a9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1316 microversion: 2.1 time: 0.112016 Jun 15 14:54:53.427740 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 199/397] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:53 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:53.521366 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:53.531933 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2b789ba7-8f47-4765-9cfd-946385ecf48d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1260 microversion: 2.1 time: 0.203702 Jun 15 14:54:53.541600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 199/398] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:53 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:54.055152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aab20a54-3ac2-4bde-a9f4-61b46e659a23 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:54.055659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aab20a54-3ac2-4bde-a9f4-61b46e659a23 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:54.062789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aab20a54-3ac2-4bde-a9f4-61b46e659a23 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.063272 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aab20a54-3ac2-4bde-a9f4-61b46e659a23 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.064069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aab20a54-3ac2-4bde-a9f4-61b46e659a23 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.064555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aab20a54-3ac2-4bde-a9f4-61b46e659a23 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.093082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aab20a54-3ac2-4bde-a9f4-61b46e659a23 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/ips" status: 200 len: 152 microversion: 2.20 time: 0.041811 Jun 15 14:54:54.093671 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 200/399] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Jun 15 14:54:54 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:54:54.444974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:54.447754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:54.453715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.454249 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.455186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.455746 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.549490 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:54.550007 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:54.558549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.559001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.561309 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.561886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.844759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:54.858943 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0a6a5fbf-3bc2-4de2-a8b2-f92a967674cd tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.418033 Jun 15 14:54:54.866686 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 200/400] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:54 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:54.922313 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:54.934960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-98a43d2b-a5b5-400d-8e2d-167d44825471 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1444 microversion: 2.1 time: 0.385948 Jun 15 14:54:54.955273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:54.956376 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:54.961690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 201/401] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:54 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1444 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:54.966842 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.967915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:54.970373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:54.971418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.361653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:55.374680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-afd0dcac-5069-4a4c-8ed2-c723dfe621e1 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1444 microversion: 2.1 time: 0.423512 Jun 15 14:54:55.376527 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 201/402] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:54 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1444 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:55.767403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-03ac2347-062e-43d4-9a58-2b11b10f7264 req-d95699b6-ddf0-48a5-95b1-75e4bd77cadc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a494d343-260a-4550-8b58-0c0007a1c0e9", "tag": "08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:55.776432 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-03ac2347-062e-43d4-9a58-2b11b10f7264 req-d95699b6-ddf0-48a5-95b1-75e4bd77cadc service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.777312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-03ac2347-062e-43d4-9a58-2b11b10f7264 req-d95699b6-ddf0-48a5-95b1-75e4bd77cadc service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.811218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-03ac2347-062e-43d4-9a58-2b11b10f7264 req-d95699b6-ddf0-48a5-95b1-75e4bd77cadc service nova] Creating event network-changed:08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 for instance a494d343-260a-4550-8b58-0c0007a1c0e9 on hv-cinder-78729 Jun 15 14:54:55.816718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-03ac2347-062e-43d4-9a58-2b11b10f7264 req-d95699b6-ddf0-48a5-95b1-75e4bd77cadc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052902 Jun 15 14:54:55.817331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 202/403] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:55.877387 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:55.877970 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:55.888898 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.889602 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:55.890553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:55.890991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:56.078817 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:56.078817 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-af82ecce-bfb9-424c-a326-6ad53356d8ac tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.200496 Jun 15 14:54:56.078817 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 202/404] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:55 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:57.093574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:57.094906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:57.108138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.111727 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.111727 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.111727 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.286450 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:57.304338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aec47c89-e8b4-4189-88cf-21f342ec8979 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.216912 Jun 15 14:54:57.304924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 203/405] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:57 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:57.778648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-7c2598aa-b1f2-48c7-9195-6c2af011de69 req-4131ca0d-a239-465a-8cc5-cc524570df35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5cf910-fe77-4ed2-9851-6b5a45f93c80", "tag": "5b0dddd1-2896-4186-9fd4-38e802bca5a6"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:57.788408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-7c2598aa-b1f2-48c7-9195-6c2af011de69 req-4131ca0d-a239-465a-8cc5-cc524570df35 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.789678 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-7c2598aa-b1f2-48c7-9195-6c2af011de69 req-4131ca0d-a239-465a-8cc5-cc524570df35 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.801385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-7c2598aa-b1f2-48c7-9195-6c2af011de69 req-4131ca0d-a239-465a-8cc5-cc524570df35 service nova] Creating event network-changed:5b0dddd1-2896-4186-9fd4-38e802bca5a6 for instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 on hv-cinder-78729 Jun 15 14:54:57.806376 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-7c2598aa-b1f2-48c7-9195-6c2af011de69 req-4131ca0d-a239-465a-8cc5-cc524570df35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Jun 15 14:54:57.806995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 203/406] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:54:57.854735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:54:57.855781 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:57.869069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:57.869942 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:57.875420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.876071 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.877282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:57.883438 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:57.904242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'flavor' on Instance uuid 7cdd536d-6f70-49a7-81e9-5a8d9a874132 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:54:58.322419 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:58.324248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:58.330997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.331872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.332733 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.333186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.514851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-806a25ab-775f-4aa0-94b6-b7668a8073ff tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/action" status: 202 len: 0 microversion: 2.20 time: 0.664702 Jun 15 14:54:58.516449 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 204/407] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jun 15 14:54:57 2022] POST /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:54:58.522413 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:58.534089 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-294f471a-d976-45a5-8f27-9cdfa43542b1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.212813 Jun 15 14:54:58.534089 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 204/408] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:58 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:54:58.534535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:58.534535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:58.539653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.540391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.542134 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:58.542824 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:58.739260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:58.750996 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:58.752535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:58.753722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fcb7dfff-9e23-45bf-bce8-cb09da33722f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.226395 Jun 15 14:54:58.754287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 205/409] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:58 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:59.550163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:59.551687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:59.556766 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=8 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:54:59.561426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.561967 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.562663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.563183 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.699897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:59.708723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-28042275-6e2b-4005-a4e8-96eb14923df9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.162438 Jun 15 14:54:59.709646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 205/410] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:54:59 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:54:59.772561 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:54:59.773331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:54:59.780141 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.780868 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.781634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:59.782066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:59.916560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:59.925369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:59.926987 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:54:59.928198 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a1e82229-a52e-4f96-8a1e-0fe5d5233adf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.159666 Jun 15 14:54:59.928756 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 206/411] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:54:59 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:00.728471 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:00.729763 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:00.741178 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.741774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.742584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.743027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.922409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:00.932659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b306cbfa-5ae0-44a7-b89e-5767e56662e8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.207171 Jun 15 14:55:00.934116 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 206/412] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:00 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:00.952738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:00.953352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:00.960774 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.961457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:00.962778 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:00.963419 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.120608 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:01.131435 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:01.133289 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:01.134491 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-54655ac6-c434-452c-aa67-df1ae4272d33 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.186004 Jun 15 14:55:01.135934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 207/413] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:00 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:01.949945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:01.950593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:01.957444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:01.966321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:01.966321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:01.966321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:02.098283 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:02.106734 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f551d8b7-cf97-42bd-807c-72d9822c2070 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.160955 Jun 15 14:55:02.107307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 207/414] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:01 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:02.154143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:02.155454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:02.161747 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:02.162203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:02.162982 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:02.163424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:02.306247 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:02.315592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:02.317180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:02.318381 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3ae023c4-4909-4a99-bcae-316c7b5e0e8d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.168703 Jun 15 14:55:02.318949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 208/415] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:02 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:03.124737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:03.125347 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:03.132445 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:03.133011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:03.133786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:03.134426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:03.274941 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:03.283035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5049f488-2308-49aa-a2a6-4e7a63b57420 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.162861 Jun 15 14:55:03.283607 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 208/416] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:03 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:03.337190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:03.337794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:03.344909 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:03.345365 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:03.346144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:03.346583 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:03.349423 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:03.487789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:03.497886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:03.499438 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:03.500642 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0626ca16-f095-478b-b3c1-89319b81a6d3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.167505 Jun 15 14:55:03.501336 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 209/417] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:03 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:04.301191 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:04.301804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:04.309489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:04.310286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:04.311065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:04.311484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:04.463832 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:04.471486 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e2c810b4-19f8-45c1-89a1-b3517db36f08 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.174100 Jun 15 14:55:04.472066 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 209/418] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:04 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:04.520231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:04.521195 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:04.527575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:04.535722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:04.535722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:04.535722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:04.669788 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:04.677955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:04.679464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:04.680662 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4a9e82b3-636d-4540-bf79-845cacf1719e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.164585 Jun 15 14:55:04.681214 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 210/419] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:04 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:05.488861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:05.489484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:05.496040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.496532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.497312 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.497756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.638959 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:05.647080 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7105e985-0efa-43aa-aed6-cec736280a2c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.161975 Jun 15 14:55:05.648027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 210/420] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:05 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:05.699875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:05.700653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:05.707427 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.707876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.708685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:05.709120 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:05.845899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:05.854318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:05.856213 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:05.857395 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6ca4dd16-0b2c-4eae-a07a-9e53d43006d6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.162431 Jun 15 14:55:05.865145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 211/421] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:05 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:06.665183 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:06.665818 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:06.673565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:06.674029 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:06.674824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:06.675290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:06.838240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:06.847817 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cae69050-c954-4803-bc20-ba2a58640ac6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.187257 Jun 15 14:55:06.848811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 211/422] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:06 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:06.875802 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:06.876570 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:06.884300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:06.884752 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:06.885533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:06.886000 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:07.053677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:07.053677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:07.054323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:07.054323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-393c5543-add8-43ce-8f9f-f49f0820051b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.173475 Jun 15 14:55:07.054323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 212/423] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:06 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:07.869828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:07.870450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:07.878697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:07.882625 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:07.882625 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:07.882625 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:07.897032 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:08.019756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:08.027145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7247ed39-4737-4350-9d1e-535bae0056b7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.162421 Jun 15 14:55:08.027706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 212/424] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:07 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:08.065004 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:08.065568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:08.071303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:08.071759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:08.072577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:08.073014 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:08.203816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:08.211960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:08.217150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:08.217150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4e8c2699-ef4c-4c8b-8808-28674b6d1cb2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.155122 Jun 15 14:55:08.217150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 213/425] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:08 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:09.044737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:09.045398 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:09.051915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:09.052395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:09.053156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:09.053588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:09.234203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:09.234799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:09.240926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:09.241377 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:09.242152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:09.242585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:09.370795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:09.378690 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5166ad4e-f159-48ed-9a7f-456c548bda86 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.337839 Jun 15 14:55:09.379355 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 213/426] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:09 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:09.400803 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:09.412107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:09.413619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:09.414784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-087e4672-d26e-427a-b89b-dc36cdf5656f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.185063 Jun 15 14:55:09.415338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 214/427] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:09 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:10.396025 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:10.396696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:10.403264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:10.403712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:10.404509 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:10.405466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:10.433654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:10.434257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:10.440893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:10.441338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:10.442090 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:10.442519 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:10.594400 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:10.604306 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-15b357c2-059f-4542-b857-7ace12e65a70 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.212103 Jun 15 14:55:10.604899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 214/428] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:10 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:10.623287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:10.632357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:10.633890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:10.635060 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-56926d9c-a51d-41a4-b8cd-e9f6db517409 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.205294 Jun 15 14:55:10.635612 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 215/429] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:10 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:11.622831 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:11.623595 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:11.633558 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.634022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:11.634885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.635330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:11.652833 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:11.653445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:11.664623 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.665335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:11.667102 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:11.667655 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:12.225428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:12.233528 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ffad5eaf-0af9-4028-8bf2-8bb5fd316055 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.615508 Jun 15 14:55:12.234241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 215/430] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:11 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:12.262363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:12.272386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:12.274019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:12.275572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cfb9a01f-b0f4-4d74-9bed-0eeac8ddfc16 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.626688 Jun 15 14:55:12.276169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 216/431] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:11 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:13.250356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:13.250949 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:13.258191 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.258644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.259432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.259873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.294352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:13.294962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:13.302283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.302844 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.303588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:13.304035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:13.460014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:13.469265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-81af8df4-8f8b-44bf-b871-3b3291734942 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.222719 Jun 15 14:55:13.483130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 216/432] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:13 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:13.488049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:13.496269 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:13.497765 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:13.499570 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d55da414-fdb9-4b21-b8f8-dde866121af5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.209085 Jun 15 14:55:13.500700 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 217/433] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:13 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:14.487083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:14.487705 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:14.494067 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.494514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.495287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.495790 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.519450 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:14.520080 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:14.527281 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.527730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.528554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:14.534783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:14.643556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:14.651117 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-70d3187b-a454-4225-b9b4-474176672f44 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.169129 Jun 15 14:55:14.651688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 217/434] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:14 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:14.727895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:14.735936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:14.737540 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:14.738628 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-086c7100-896d-4c4d-bf48-90b344b0f0e3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.223136 Jun 15 14:55:14.739179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 218/435] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:14 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:15.668620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:15.669227 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:15.675891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.676444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.677204 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.677638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.756608 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:15.757501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:15.763476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.764663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.765477 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:15.765921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:15.818680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:15.826346 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d78d0534-9c4a-496b-9c1f-44c63c480265 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.161509 Jun 15 14:55:15.827568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 218/436] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:15 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:15.902839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:15.912013 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:15.913558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:15.914972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-25250c79-3f3e-49cb-9722-d32bfcffc716 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.162036 Jun 15 14:55:15.915307 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 219/437] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:15 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:16.844847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:16.845387 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:16.851986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.852470 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:16.853276 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.853717 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:16.937774 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:16.937774 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:16.943857 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.944341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:16.945116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:16.945805 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:17.044974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:17.056566 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8927cad0-f59f-4f25-b5c4-4de4c16b2462 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.216470 Jun 15 14:55:17.058015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 219/438] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:16 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:17.121532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:17.129565 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:17.131068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:17.132556 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1dfe159f-ea05-4db3-b5af-f13390c3d254 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.199670 Jun 15 14:55:17.133116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 220/439] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:16 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:18.074587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:18.075189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:18.081935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:18.082415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.083182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:18.083613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.151166 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:18.152762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:18.158794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:18.159250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.160033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:18.160507 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.254076 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:18.261871 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ad71a7e3-b35b-465a-80e2-717768329eba tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.191412 Jun 15 14:55:18.262437 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 220/440] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:18 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:18.309944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:18.317904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:18.319442 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:18.320663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-87a77524-c932-4aeb-984e-b899c22fbded tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.173777 Jun 15 14:55:18.321225 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 221/441] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:18 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:18.937311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-8d9eb410-b09b-424f-9986-88f2352cd398 req-89da067d-e385-45ba-885b-24219d337c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a494d343-260a-4550-8b58-0c0007a1c0e9", "name": "network-vif-plugged", "status": "completed", "tag": "08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:18.946341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8d9eb410-b09b-424f-9986-88f2352cd398 req-89da067d-e385-45ba-885b-24219d337c66 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:18.946784 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8d9eb410-b09b-424f-9986-88f2352cd398 req-89da067d-e385-45ba-885b-24219d337c66 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:18.959051 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-8d9eb410-b09b-424f-9986-88f2352cd398 req-89da067d-e385-45ba-885b-24219d337c66 service nova] Creating event network-vif-plugged:08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 for instance a494d343-260a-4550-8b58-0c0007a1c0e9 on hv-cinder-78729 Jun 15 14:55:18.964189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-8d9eb410-b09b-424f-9986-88f2352cd398 req-89da067d-e385-45ba-885b-24219d337c66 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034412 Jun 15 14:55:18.964774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 221/442] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:19.186578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:55:19.187351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Wed Jun 15 14:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:55:19.278744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:19.279381 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:19.287248 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.287879 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.288715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.289147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.339948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:19.340674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:19.347132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.347587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.348403 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:19.348834 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:19.520759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:19.528217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f28cd70-6e36-41b9-8b36-3a0a5afb0baa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.253270 Jun 15 14:55:19.535142 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 222/443] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:19 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:19.569061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:19.577305 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:19.578913 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:19.580077 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6d791913-1cc8-4b1f-9611-24694c1a49d9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.244907 Jun 15 14:55:19.580783 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 222/444] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:19 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:20.546770 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:20.547572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:20.553635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.554076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.554824 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.555253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.598409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:20.599146 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:20.606612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.608237 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.609208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:20.610474 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:20.729588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:20.738145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ee83e2fd-a423-4d65-b0ce-c496c34dd8be tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.195765 Jun 15 14:55:20.738737 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 223/445] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:20 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:20.779060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:20.788645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:20.790168 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:20.791453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cbb1e0d8-2511-40e7-b605-5e19c3abf48b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.196800 Jun 15 14:55:20.791915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 223/446] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:20 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:21.757017 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:21.757624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:21.759597 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=56 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:21.765232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.765750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.766840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.767249 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.812573 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:21.813124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:21.820255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.820712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.822462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:21.822462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:21.966200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:21.975237 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8d28e341-d8b2-4a7e-a78c-023643b64943 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1358 microversion: 2.1 time: 0.222418 Jun 15 14:55:21.975816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 224/447] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:21 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:21.995392 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:22.002379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:22.003916 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:22.005139 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3e6f26aa-ee6f-4174-8e09-77d16460a435 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.198719 Jun 15 14:55:22.005707 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 224/448] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:21 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:22.992299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:22.992940 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:22.999289 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:22.999827 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.000610 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.001055 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.023754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:23.024716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:23.026860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=54 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:23.032656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.033106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.033873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.034310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.219965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.223517 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:23.227339 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.228696 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3beea22c-59a6-46a9-8067-0ef74416d429 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1548 microversion: 2.1 time: 0.240329 Jun 15 14:55:23.229599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 225/449] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:22 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:23.235778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.237367 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.238548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-74fa15be-903f-4a15-8e10-3972c5270674 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.218749 Jun 15 14:55:23.239117 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 225/450] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:23 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:23.245629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:23.246183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:23.256162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.256884 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.257773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.258247 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.405217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.413280 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7e9fdad2-64a2-41c4-8413-0ac83d0d46b3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1548 microversion: 2.1 time: 0.171505 Jun 15 14:55:23.413849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 226/451] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:23 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:23.429654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:23.438290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.438290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Searching by: {'deleted': False, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408'} {{(pid=124660) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 14:55:23.442312 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.442757 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.443690 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.444058 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.538981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.multi_cell_list [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124660) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 14:55:23.642546 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4e987d48-4cd5-4c9c-9045-76d57a9e8f03 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216739 Jun 15 14:55:23.643128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 226/452] 10.222.0.42 () {58 vars in 1124 bytes} [Wed Jun 15 14:55:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:23.654502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:23.655548 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:23.661739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.662194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.664147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:23.664147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:23.820661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:23.828309 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-66ed95a7-5e87-4e04-82c2-05282c68c067 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1548 microversion: 2.1 time: 0.177622 Jun 15 14:55:23.828886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 227/453] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:23 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:24.258260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:24.258870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:24.265632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:24.266825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:24.267669 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:24.268142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:24.413175 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:24.422375 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:24.423949 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:24.425220 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-06400bc5-b368-4667-b355-31dafce6c758 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.171218 Jun 15 14:55:24.425786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 227/454] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:24 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:25.447527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:25.448161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:25.454456 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:25.454915 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:25.455684 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:25.456157 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:25.590022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:25.599468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:25.601050 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:25.602218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c0b9db45-506f-4498-996e-f266e04ca1dd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.158588 Jun 15 14:55:25.602780 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 228/455] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:25 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:26.620710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:26.621328 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:26.628192 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:26.628654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:26.629426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:26.629867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:26.740349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ce07032c-06aa-4775-8745-1cd9c18ad12e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e83d157-8671-4302-bfac-a72bab50359e"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:26.741463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ce07032c-06aa-4775-8745-1cd9c18ad12e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:26.748502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce07032c-06aa-4775-8745-1cd9c18ad12e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:26.749319 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce07032c-06aa-4775-8745-1cd9c18ad12e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:26.749797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce07032c-06aa-4775-8745-1cd9c18ad12e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:26.750232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce07032c-06aa-4775-8745-1cd9c18ad12e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:26.767923 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:26.776104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:26.777787 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:26.778951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-585471fe-ac36-4c8c-ab03-64135364d60e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.162069 Jun 15 14:55:26.780195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 228/456] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:26 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:27.645229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ce07032c-06aa-4775-8745-1cd9c18ad12e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908628 Jun 15 14:55:27.645928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 229/457] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 14:55:26 2022] POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:55:27.799526 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:27.800169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:27.806060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:27.806511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:27.807274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:27.807713 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:27.823038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:27.943432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:27.951657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:27.953222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:27.954397 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-080ef1f5-0208-4de7-84da-6978f74f5464 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.159646 Jun 15 14:55:27.954968 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 229/458] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:27 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:28.973619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:28.974228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:28.981260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:28.981684 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:28.983107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:28.983537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:29.119897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:29.128784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:29.130298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:29.131717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-73e0153c-91fb-4f21-8544-74db0920a68f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.162505 Jun 15 14:55:29.132300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 230/459] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:28 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:30.150296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:30.150909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:30.158044 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:30.158473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:30.159230 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:30.159663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:30.298974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:30.312501 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:30.314039 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:30.315200 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e7453415-7298-4a12-8f63-3e50a65c0bd2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.169260 Jun 15 14:55:30.315757 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 230/460] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:30 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:30.632524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a7098545-343e-4479-8ddb-3d7a09b9ea35 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b96c4276-9448-4552-abaf-ba083559aa45"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:30.633625 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a7098545-343e-4479-8ddb-3d7a09b9ea35 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:30.640402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7098545-343e-4479-8ddb-3d7a09b9ea35 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:30.640861 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7098545-343e-4479-8ddb-3d7a09b9ea35 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:30.641660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7098545-343e-4479-8ddb-3d7a09b9ea35 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:30.642094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a7098545-343e-4479-8ddb-3d7a09b9ea35 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:31.333651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:31.334275 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:31.341035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:31.341600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:31.342454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:31.342971 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:31.491677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:31.500027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:31.501577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:31.504520 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a7098545-343e-4479-8ddb-3d7a09b9ea35 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987979 Jun 15 14:55:31.504687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d895799d-d88f-47e7-8804-b88275fe7285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.173179 Jun 15 14:55:31.504791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 231/461] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 14:55:30 2022] POST /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:31.505056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 231/462] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:31 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:32.532915 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:32.548840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:32.548840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:32.548840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:32.548840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:32.549245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:32.677271 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:32.685226 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:32.686624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:32.687783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b4ed6207-64ee-4d9d-b21f-571f24cf4a74 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.160627 Jun 15 14:55:32.688387 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 232/463] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:32 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:33.036433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-0b5be3f5-4bec-4b57-b8e6-cbd7779eb14d req-2eda8776-eae6-40cb-a3c1-6feefadeb717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdd536d-6f70-49a7-81e9-5a8d9a874132", "name": "network-vif-plugged", "status": "completed", "tag": "63af79cd-c2b3-45e8-8480-b3fcb4df3beb"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:33.045123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-0b5be3f5-4bec-4b57-b8e6-cbd7779eb14d req-2eda8776-eae6-40cb-a3c1-6feefadeb717 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:33.049042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-0b5be3f5-4bec-4b57-b8e6-cbd7779eb14d req-2eda8776-eae6-40cb-a3c1-6feefadeb717 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:33.056734 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-0b5be3f5-4bec-4b57-b8e6-cbd7779eb14d req-2eda8776-eae6-40cb-a3c1-6feefadeb717 service nova] Creating event network-vif-plugged:63af79cd-c2b3-45e8-8480-b3fcb4df3beb for instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 on hv-cinder-78729 Jun 15 14:55:33.063297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-0b5be3f5-4bec-4b57-b8e6-cbd7779eb14d req-2eda8776-eae6-40cb-a3c1-6feefadeb717 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030329 Jun 15 14:55:33.063765 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 232/464] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:33.706637 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:33.707251 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:33.714521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:33.714969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:33.715734 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:33.716214 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:33.863232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:33.871734 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:33.873910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:33.875126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-456c2975-2905-4683-ae25-e3115b64b4bd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.172395 Jun 15 14:55:33.875682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 233/465] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:33 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:34.891836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:34.896412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:34.897132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:34.903213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:34.907407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:34.907407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:34.907407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:35.046870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:35.059827 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:35.062792 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:35.064551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-19eb704e-01e3-401a-9b73-35f20a86f9da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.173551 Jun 15 14:55:35.065303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 233/466] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:34 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:36.086924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:36.087613 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:36.094629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:36.095072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:36.095862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:36.096411 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:36.243845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:36.252794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:36.254295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:36.255463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ba19a82d-a964-4fcb-9c72-7fb0fd76fa59 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.172571 Jun 15 14:55:36.256007 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 234/467] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:36 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:37.276407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:37.276951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:37.283653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:37.284127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:37.284959 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:37.285564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:37.332362 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:37.333225 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:37.339895 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:37.342443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:37.342443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:37.342443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:37.477077 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:37.488408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:37.489925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:37.491099 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c9221d1c-3040-4ea3-b85e-d33ec00f7af3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1745 microversion: 2.20 time: 0.220362 Jun 15 14:55:37.491655 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 234/468] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:37 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1745 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:37.507546 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:37.516277 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4dc061ab-9cc3-4720-ba35-6d247eb933b2 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1594 microversion: 2.1 time: 0.188042 Jun 15 14:55:37.517218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 235/469] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:37 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1594 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:38.511252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:38.511855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:38.519090 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:38.519545 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:38.520358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:38.520800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:38.678068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:38.692650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:38.694384 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:38.695791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fcc433b7-afd0-4594-8b32-110222874be5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.188430 Jun 15 14:55:38.696939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 235/470] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:38 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:39.721739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:39.722513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:39.732602 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:39.733566 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:39.734600 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:39.735278 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:39.896549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:39.908162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:39.911558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:39.913087 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-42e27ab3-ad85-47b4-9a88-1e40ac25485b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.195562 Jun 15 14:55:39.913862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 236/471] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:39 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:40.333432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-76495e32-81b2-4d6a-8d01-54dc0b2427c9 req-8aaa30e1-3d23-476c-b0fa-be07df428c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a494d343-260a-4550-8b58-0c0007a1c0e9", "tag": "08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:40.351712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-76495e32-81b2-4d6a-8d01-54dc0b2427c9 req-8aaa30e1-3d23-476c-b0fa-be07df428c27 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:40.354854 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-76495e32-81b2-4d6a-8d01-54dc0b2427c9 req-8aaa30e1-3d23-476c-b0fa-be07df428c27 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:40.366737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-76495e32-81b2-4d6a-8d01-54dc0b2427c9 req-8aaa30e1-3d23-476c-b0fa-be07df428c27 service nova] Creating event network-changed:08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 for instance a494d343-260a-4550-8b58-0c0007a1c0e9 on hv-cinder-78729 Jun 15 14:55:40.374444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-76495e32-81b2-4d6a-8d01-54dc0b2427c9 req-8aaa30e1-3d23-476c-b0fa-be07df428c27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050268 Jun 15 14:55:40.375106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 236/472] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:40.933923 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:40.934542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:40.948763 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:40.955391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:40.956283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:40.956735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:41.245544 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:41.288576 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:41.290311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:41.291733 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-200977f9-d40f-44f4-bb7e-981171362543 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.363547 Jun 15 14:55:41.301027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 237/473] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:40 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:42.322310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:42.322893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:42.329609 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:42.330058 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:42.330819 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:42.331252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:42.524003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:42.534642 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:42.536210 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:42.537541 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-79a77b90-ed30-439d-9ed1-eac1cde82403 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.221618 Jun 15 14:55:42.538168 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 237/474] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:42 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:43.558926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:43.559686 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:43.570221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:43.570469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:43.571367 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:43.571953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:43.880145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1200325976"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:43.880659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:43.887753 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:43.888767 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:43.889916 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:43.890605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:44.102239 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:44.117015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.network.security_group_api [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Adding security group 732600f0-725c-4ccf-9bef-a68b6c56042a to port 08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 Jun 15 14:55:44.117173 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:44.121726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:44.124404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-55a3f69d-9a1e-498d-b3e9-dd5d08970975 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.571666 Jun 15 14:55:44.125227 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 238/475] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:43 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:44.765852 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cf792451-fc00-4e37-bcba-e2165c188e1e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.889210 Jun 15 14:55:44.766686 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 238/476] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:55:43 2022] POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:55:44.782428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:44.784206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:44.806030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:44.816304 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:44.823998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:44.826091 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:44.962276 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-1cd38bd0-59cc-4b19-8d33-bbc8d5738be5 req-913f9b44-ad67-43c5-9b4d-e1baeaace3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a494d343-260a-4550-8b58-0c0007a1c0e9", "tag": "08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:44.974882 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-1cd38bd0-59cc-4b19-8d33-bbc8d5738be5 req-913f9b44-ad67-43c5-9b4d-e1baeaace3b4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:44.975725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-1cd38bd0-59cc-4b19-8d33-bbc8d5738be5 req-913f9b44-ad67-43c5-9b4d-e1baeaace3b4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:45.014756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-1cd38bd0-59cc-4b19-8d33-bbc8d5738be5 req-913f9b44-ad67-43c5-9b4d-e1baeaace3b4 service nova] Creating event network-changed:08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 for instance a494d343-260a-4550-8b58-0c0007a1c0e9 on hv-cinder-78729 Jun 15 14:55:45.024358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-1cd38bd0-59cc-4b19-8d33-bbc8d5738be5 req-913f9b44-ad67-43c5-9b4d-e1baeaace3b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230745 Jun 15 14:55:45.025684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 239/477] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:45.148317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:45.149181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:45.166533 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:45.170983 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:45.173957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:45.181800 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:45.189492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:45.191332 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:45.195765 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2c750b32-1af3-429c-b150-d827a42c0778 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1759 microversion: 2.1 time: 0.424634 Jun 15 14:55:45.200829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 239/478] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:44 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1759 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:45.490907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:45.503940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:45.505537 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:45.518123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-08f326b6-aa67-49d8-afd5-cb28295c4ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.373418 Jun 15 14:55:45.518123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 240/479] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:45 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:45.665439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:45.665439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:45.677898 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:45.678367 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:45.679265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:45.679715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:45.708601 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'flavor' on Instance uuid b916fb35-c3eb-4252-9420-c26effc3069f {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:55:46.115996 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3eb70db2-7fbe-4ba6-86ea-480d463d3d9a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/action" status: 200 len: 32 microversion: 2.1 time: 0.459043 Jun 15 14:55:46.117775 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 240/480] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:55:45 2022] POST /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:55:46.128879 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:46.129916 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:46.140080 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:46.140581 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:46.141617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:46.142358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:46.369552 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:46.388679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2c2b50de-2521-4b6e-8ded-4f597a8f8bb9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.265091 Jun 15 14:55:46.393507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 241/481] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:46 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:46.538066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:46.539310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:46.547182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:46.547969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:46.548974 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:46.549664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:46.774664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:46.784834 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:46.786288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:46.787450 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fc20f8ad-dc90-4fdc-a2ec-a67dc8bc875e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.254773 Jun 15 14:55:46.788237 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 241/482] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:46 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:47.410298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:47.410976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:47.417441 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.417889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:47.418649 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.419135 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:47.570319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:47.578995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-eeeb1406-9602-4f42-abbe-d2fabbad1bc8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.172472 Jun 15 14:55:47.579858 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 242/483] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:47 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:47.805217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:47.806680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:47.814215 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.814689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:47.815455 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:47.816112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.022346 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:48.032330 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:48.033834 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:48.035221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-554aa4c4-2ab3-42f8-8f94-16c554a8f771 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.233829 Jun 15 14:55:48.036271 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 242/484] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:47 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:48.597149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:48.597761 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:48.618755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.619366 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.620304 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.620813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.776287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:48.787087 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f619d9d2-22ca-43e2-896a-ac990fbdfed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.194125 Jun 15 14:55:48.787893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 243/485] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:48 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:49.057010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:49.059082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:49.067531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.067984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.068801 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.069244 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.242188 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:49.251647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:49.253282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:49.254552 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b4e74d54-3068-40a7-8325-90385b284648 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.204298 Jun 15 14:55:49.255127 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 243/486] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:49 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:49.804791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:49.808604 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:49.817162 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.817972 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.819670 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.820846 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.982221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:49.992878 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ca539e16-f29c-4175-bcbe-ee6f6ae04ef4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.191939 Jun 15 14:55:49.993445 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 244/487] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:49 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:50.275107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:50.275707 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:50.283267 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:50.283988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:50.284531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:50.284970 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:50.454576 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:50.463248 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:50.464881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:50.466787 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f219c1d7-2b34-4f63-9cda-773a39b2fa20 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.195129 Jun 15 14:55:50.467759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 244/488] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:50 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:51.012770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:51.014324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:51.021886 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:51.022480 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:51.023335 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:51.023796 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:51.168774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:51.178469 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-760b5460-cdcb-4e43-8713-cbff4ee61b2e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.169629 Jun 15 14:55:51.178812 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 245/489] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:51 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:51.487886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:51.489221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:51.496035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:51.496812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:51.498569 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:51.499186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:51.649719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:51.659277 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:51.661158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:51.662398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b29eea4c-daf0-4d26-9174-ebadbbf013cf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.179108 Jun 15 14:55:51.662978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 245/490] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:51 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:52.198895 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:52.199551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:52.206557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:52.207008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:52.207778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:52.208255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:52.342262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:52.350593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-64975e28-7a09-45bc-a965-befa5487dead tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.155636 Jun 15 14:55:52.351168 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 246/491] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:52 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:52.681657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:52.682260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:52.685184 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=44 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:52.690199 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:52.696481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:52.696481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:52.696481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:52.823350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:52.832215 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:52.833731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:52.834883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-872ec205-b6bc-4081-995f-0c748f091802 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.157390 Jun 15 14:55:52.835435 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 246/492] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:52 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:55:53.370671 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:53.371356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:53.374995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=44 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:53.379822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.380329 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:53.381389 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.381837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:53.527379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:53.535932 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-525ed475-e376-4799-bec6-ea55103d98cc tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.171343 Jun 15 14:55:53.536547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 247/493] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:53 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:53.854150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:53.854690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:53.861700 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.862142 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:53.862993 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.863432 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:54.000147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:54.008574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:54.010070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:54.011273 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-35de9539-6301-4521-8238-288722966db3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1740 microversion: 2.20 time: 0.161398 Jun 15 14:55:54.011871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 247/494] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:53 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:54.553886 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:54.555314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:54.561799 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:54.562245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:54.564311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:54.564311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:54.580201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:54.789065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:54.797496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f77fcad7-0270-4cd7-86c1-6379164e5b77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.247299 Jun 15 14:55:54.798065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 248/495] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:54 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:55.029358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:55.030037 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:55.036618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.037066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.037848 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.038292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.167803 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:55.176541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:55.178037 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:55.179179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-36bbc155-8383-4cf8-b4cc-c5e045157a7b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1722 microversion: 2.20 time: 0.153981 Jun 15 14:55:55.179728 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 248/496] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:55 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:55.816590 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:55.817241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:55.823744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.828156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.828156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.828156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.953503 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:55.961675 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-173a3c1c-5c22-4f6c-b961-e8ae22cfdbbf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.149791 Jun 15 14:55:55.962244 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 249/497] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:55 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:56.197997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:56.198629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:56.205204 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.205647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.206409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.206836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.344203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:56.352354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:56.353866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:56.355020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-921f5cd3-4f94-44b6-abbb-c0b21c7e72be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1722 microversion: 2.20 time: 0.161286 Jun 15 14:55:56.355578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 249/498] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:56 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:56.979184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:56.979834 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:56.986256 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.986706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.987525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:56.987966 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.084773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-954b7b26-e384-42f7-a68d-a65518fe9b28 req-460885ac-436d-4171-a1e3-c96f2d5f0e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdd536d-6f70-49a7-81e9-5a8d9a874132", "name": "network-vif-unplugged", "status": "completed", "tag": "63af79cd-c2b3-45e8-8480-b3fcb4df3beb"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:57.093395 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-954b7b26-e384-42f7-a68d-a65518fe9b28 req-460885ac-436d-4171-a1e3-c96f2d5f0e6e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.094402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-954b7b26-e384-42f7-a68d-a65518fe9b28 req-460885ac-436d-4171-a1e3-c96f2d5f0e6e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.107496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-954b7b26-e384-42f7-a68d-a65518fe9b28 req-460885ac-436d-4171-a1e3-c96f2d5f0e6e service nova] Creating event network-vif-unplugged:63af79cd-c2b3-45e8-8480-b3fcb4df3beb for instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 on hv-cinder-78729 Jun 15 14:55:57.112846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-954b7b26-e384-42f7-a68d-a65518fe9b28 req-460885ac-436d-4171-a1e3-c96f2d5f0e6e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031708 Jun 15 14:55:57.113667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 250/499] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:55:57.121693 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:57.131234 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a7715790-d8e3-4dc4-882f-9aa1fd5d8c5d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.155780 Jun 15 14:55:57.131805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 250/500] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:56 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:57.375630 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:57.376364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:57.383155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.383609 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.384417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.384862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.520198 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:57.528410 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:57.530038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:57.531194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-25a7b3bb-c351-442a-8306-b60a83a0acb6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1722 microversion: 2.20 time: 0.160513 Jun 15 14:55:57.531757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 251/501] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:57 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:58.149279 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:58.149915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:58.157208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.157659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:58.158415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.158848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:58.290557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:58.298685 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c92ed80c-6182-4ad3-a39c-9df776977ffd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.153358 Jun 15 14:55:58.299254 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 251/502] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:58 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:58.550109 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:58.550741 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:58.557090 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.557544 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:58.558321 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.558760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:58.695951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:58.704668 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:58.707040 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:58.708454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-946a9f17-6b1d-4e7f-8128-21fd64f54530 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1725 microversion: 2.20 time: 0.162944 Jun 15 14:55:58.709016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 252/503] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:55:58 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:55:58.729560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8a24c72d-1991-42b8-80b4-c9f1a6a1e3e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6493d8a-24e2-45e5-916d-93eebe8af00a"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:58.730679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8a24c72d-1991-42b8-80b4-c9f1a6a1e3e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:58.737324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a24c72d-1991-42b8-80b4-c9f1a6a1e3e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.737801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a24c72d-1991-42b8-80b4-c9f1a6a1e3e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:58.738568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a24c72d-1991-42b8-80b4-c9f1a6a1e3e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.738998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a24c72d-1991-42b8-80b4-c9f1a6a1e3e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:59.315042 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:59.315651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:59.321821 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:59.322270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:59.323036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:59.323472 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:59.455924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:59.464101 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e7eb7b26-d585-42c1-8d92-a29e376d7b30 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.153084 Jun 15 14:55:59.467633 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 253/504] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:59 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:59.821885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8a24c72d-1991-42b8-80b4-c9f1a6a1e3e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.096231 Jun 15 14:55:59.822702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 252/505] 10.222.0.42 () {62 vars in 1363 bytes} [Wed Jun 15 14:55:58 2022] POST /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments => generated 188 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:55:59.938001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a56c5345-5a88-4333-96e6-e331d9b3d40a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:59.938781 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a56c5345-5a88-4333-96e6-e331d9b3d40a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:59.945045 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a56c5345-5a88-4333-96e6-e331d9b3d40a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:59.945493 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a56c5345-5a88-4333-96e6-e331d9b3d40a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:59.946254 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a56c5345-5a88-4333-96e6-e331d9b3d40a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:59.946682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a56c5345-5a88-4333-96e6-e331d9b3d40a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:00.048162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:00.270351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a56c5345-5a88-4333-96e6-e331d9b3d40a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/action" status: 202 len: 0 microversion: 2.20 time: 0.336293 Jun 15 14:56:00.270988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 254/506] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jun 15 14:55:59 2022] POST /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:56:00.279489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:00.280124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:00.288566 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:00.293021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:00.293021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:00.293021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:00.426644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:00.435544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:00.437313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:00.438621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4c99a4da-8567-4354-9f4b-796d618cd639 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1751 microversion: 2.20 time: 0.163141 Jun 15 14:56:00.443459 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 253/507] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:00 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:00.482018 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:00.482632 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:00.489457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:00.489903 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:00.492650 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:00.493125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:00.637835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:00.646961 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4674c6e3-a247-4821-95a3-4fa7dda765b4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.168938 Jun 15 14:56:00.647532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 255/508] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:00 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:01.457585 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:01.458232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:01.464806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:01.465255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:01.466022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:01.466454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:01.608580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:01.617188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:01.618810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:01.619969 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a4942b61-8ec6-4246-9eb9-3378d6620318 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1751 microversion: 2.20 time: 0.166400 Jun 15 14:56:01.620572 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 254/509] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:01 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:01.664781 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:01.665384 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:01.672558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:01.673044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:01.673829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:01.674272 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:01.810208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:01.818960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0396080c-98ff-403b-b312-1a1630c888b7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.157930 Jun 15 14:56:01.823391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 256/510] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:01 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:02.639519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:02.640784 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:02.647353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:02.647653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:02.648432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:02.648865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:02.784816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:02.793112 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:02.794689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:02.795834 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fce138e4-7180-42e3-b6a9-ebdbea944fc0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1753 microversion: 2.20 time: 0.160817 Jun 15 14:56:02.796525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 255/511] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:02 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:02.836880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:02.837489 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:02.844110 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:02.844554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:02.845310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:02.845741 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:02.978249 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:02.986467 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f4b8bb5a-f9ee-46d4-9860-71c890820bd0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.153327 Jun 15 14:56:02.987027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 257/512] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:02 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:03.814630 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:03.815265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:03.822758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:03.823210 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:03.823981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:03.824449 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:03.957483 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:03.966446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:03.967976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:03.969145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bf08acaa-7e1b-49da-883b-d7ab0129e29a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1753 microversion: 2.20 time: 0.159020 Jun 15 14:56:03.970065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 256/513] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:03 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:04.004121 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:04.004732 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:04.011420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:04.011873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:04.012660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:04.013095 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:04.151330 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:04.159419 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a2c8deab-805a-42ad-95e6-d539749b1eca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.160106 Jun 15 14:56:04.159982 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 258/514] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:03 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:04.988181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:04.988783 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:04.995903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:04.996388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:04.997157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:04.997587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:05.176935 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:05.177562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:05.184261 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:05.184720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:05.185501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:05.185941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:05.200749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:05.210940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:05.212554 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:05.213788 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-76944c62-67fa-493c-bec0-51914bb835d7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.229781 Jun 15 14:56:05.224884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 257/515] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:04 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:05.379182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:05.387556 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-25648b40-63a8-4c76-8323-b689ab94eefd tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.214614 Jun 15 14:56:05.388152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 259/516] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:05 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:06.232893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:06.233548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:06.242958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:06.243415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:06.244245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:06.244920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:06.383418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:06.396637 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:06.398182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:06.399391 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2f255bb1-e528-448f-8430-d43a98956948 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.170676 Jun 15 14:56:06.399941 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 258/517] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:06 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:06.405593 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:06.406263 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:06.413408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:06.413850 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:06.414657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:06.415192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:06.547776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:06.557554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5432dad2-c14f-4827-b98f-fbe77492a947 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.155519 Jun 15 14:56:06.558689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 260/518] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:06 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:07.418221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:07.418849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:07.426710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.427157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.427926 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.428380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.572405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.576556 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:07.577181 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:07.582687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.584242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.584793 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.585250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.585415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2c1acfb7-555d-4b8e-a84c-bb68c6cc8d0e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.171210 Jun 15 14:56:07.585994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 259/519] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:07 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:07.586125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.586598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.729795 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.742611 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3d845d57-a746-4450-bc0f-908a536465eb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.170016 Jun 15 14:56:07.743041 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 261/520] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:07 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:08.603912 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:08.604598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:08.611911 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.612409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:08.613156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.613590 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:08.761511 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:08.762155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:08.774022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.779750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:08.781371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.782423 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.020867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.031073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.033395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.034629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3c20ae2e-2abc-4ec6-a757-26e04e11ead0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.435155 Jun 15 14:56:09.046196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 260/521] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:08 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:09.119981 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.129107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c453cc4f-91bd-4265-a8a3-d26fa6b98165 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.371432 Jun 15 14:56:09.129693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 262/522] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:08 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:10.053745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:10.054380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:10.061616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.062066 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.063054 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.063648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.146767 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:10.147385 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:10.153976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.154426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.155208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.155636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.218101 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.227570 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.229115 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.230322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e2931992-804e-469f-ac38-63f43070a47b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.180770 Jun 15 14:56:10.231022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 261/523] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:10 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:10.312363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.321665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8e932ab2-3eb8-4cc1-ae4d-e8db0bcf22ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.178668 Jun 15 14:56:10.327709 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 263/524] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:10 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:11.249963 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:11.250595 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:11.257740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.263356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.263356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.263356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.274447 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:11.340294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:11.340949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:11.348706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.349166 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.349989 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.353237 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.443414 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.453812 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.462313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.462313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b407eec1-4d7a-43c4-a1dd-0951c9877200 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.216236 Jun 15 14:56:11.462918 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 262/525] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:11 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:11.518126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.526343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b9867a76-43f4-4a04-9468-5547ce828e27 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.189966 Jun 15 14:56:11.526934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 264/526] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:11 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:12.480624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:12.481241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:12.489023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.489497 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.490273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.490731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.544485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:12.549515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:12.552769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.553199 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.553910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.554349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.699910 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.710065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.711586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.712792 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-874a7ebd-5c6c-4600-a305-accfb89171b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.236461 Jun 15 14:56:12.713365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 263/527] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:12 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:12.732054 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.740295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6765bb02-8085-4d91-9dcf-334901219f95 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.199723 Jun 15 14:56:12.740867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 265/528] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:12 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:13.730488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:13.731214 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:13.738816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.738816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.739498 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.739936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.758418 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:13.759049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:13.770693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.784216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.784216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.784216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.938880 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.949310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.951246 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.952653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-56764df9-c1b2-4335-9066-0f714c3e9790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.226054 Jun 15 14:56:13.964502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 264/529] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:13 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:13.966209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.977101 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3e4bcbc2-434c-49e1-a68c-8f1d5b6ff1fb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.222813 Jun 15 14:56:13.977695 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 266/530] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:13 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:14.079641 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:14.080179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:14.086497 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.087016 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.087770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.088245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.220712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lazy-loading 'services' on Instance uuid 9af1b5d3-7171-4426-b239-bc34951326cf {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:56:14.468903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c5e2fb2b-a2df-4f95-bdbf-6bb66a62fafb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-volume_attachments/71e626ea-5fc9-4c9b-ac78-4dc72dd068b0" status: 202 len: 0 microversion: 2.1 time: 0.502587 Jun 15 14:56:14.469690 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 265/531] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 14:56:13 2022] DELETE /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-volume_attachments/71e626ea-5fc9-4c9b-ac78-4dc72dd068b0 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:56:14.973680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:14.974476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:14.981633 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.982081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.982925 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.983364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.997493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:14.998341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:15.005216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:15.005921 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:15.006694 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:15.007130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:15.200116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:15.208938 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:15.212513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:15.214053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:15.215529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-352ea7ac-43c0-4335-8c0a-2317a8039892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.247746 Jun 15 14:56:15.216256 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 267/532] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:14 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:15.218098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bde5cc0d-b29d-4939-bce4-409d6b44165f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.225340 Jun 15 14:56:15.218663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 266/533] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:14 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:16.235609 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:16.236963 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:16.237386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:16.238646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:16.245925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.246720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.247849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.248482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.248872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.248989 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.249721 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.250154 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.461781 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.466384 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.470225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3b292242-ba08-4f17-82b8-0b150d7e3963 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.238318 Jun 15 14:56:16.471458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 267/534] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:16 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:16.476912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.478439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.479627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b23225bf-41c1-4fa8-8418-06e147f26694 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.247862 Jun 15 14:56:16.480206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 268/535] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:16 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:17.488422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:17.490179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:17.496019 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.496750 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.497442 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.497874 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.498596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:17.499211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:17.507572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.508022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.508821 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.509255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.703152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.711316 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.713179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.714691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.715881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ea4d61ec-f547-4cb8-acd2-73a64c597b73 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.221182 Jun 15 14:56:17.716849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 269/536] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:17 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:17.720717 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ba3738c2-3ebd-4647-a4b2-68dc9a81bb9c tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.236041 Jun 15 14:56:17.721295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 268/537] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:17 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:18.734263 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:18.734978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:18.738466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:18.739943 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:18.742617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.743065 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.743922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.744378 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.747137 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.747847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.748842 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.749291 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.943547 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:18.945836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:18.952773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:18.954413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:18.955075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:18.955706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8c89d4b3-908a-4ba0-ad13-11be76ef9655 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.225316 Jun 15 14:56:18.956304 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 270/538] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:18 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:18.963808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-57a2349e-e44b-4748-92cd-7c1caf7a43ec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.229366 Jun 15 14:56:18.964411 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 269/539] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:18 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:19.978243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:19.978929 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:19.981552 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:19.982252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:19.986094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.986542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.987324 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.987757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.988710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.008422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.008422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.008422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.198617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.203013 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.207047 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a5601f20-3ec5-4bc1-8092-095fbdf9baba tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.229231 Jun 15 14:56:20.208362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 270/540] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:19 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:20.215382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.216925 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.218096 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c0c5df0a-7a19-4e99-9e0c-5e7cda60c141 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.245030 Jun 15 14:56:20.218637 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 271/541] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:19 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:21.225685 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:21.226708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:21.233974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.234431 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.235212 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.235662 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.241138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:21.241759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:21.248348 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.248802 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.249575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.250018 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.445925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:21.450111 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:21.454323 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c0c0aeb6-9a0c-4025-9f87-2ab21f76b0e9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.232795 Jun 15 14:56:21.454906 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 271/542] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:21 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:21.458947 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:21.460477 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:21.461740 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6887ed4f-30a9-43fd-b86f-be8b3b5ddefd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.226324 Jun 15 14:56:21.462288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 272/543] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:21 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:22.471580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:22.472222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:22.479734 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.480077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:22.480534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.480863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:22.480976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.481392 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.487912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.488675 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.490062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.491088 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.693054 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.697081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.701440 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8a2c800c-8c28-4e5b-9702-d8d7606c6fec tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.233818 Jun 15 14:56:22.702096 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 272/544] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:22 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:22.705606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.707238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.708979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fdd8ba57-06ad-4743-bfcb-4e93a6767007 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.232733 Jun 15 14:56:22.709537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 273/545] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:22 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:23.722042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:23.722679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:23.725879 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=52 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:23.727064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:23.727815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:23.730236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=58 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:23.730813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.737182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.737182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.737182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.737497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.737497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.737497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.737497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.935680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.943795 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.944274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-193e1d3b-6760-4d27-a1c9-413a6afd84f2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.225950 Jun 15 14:56:23.944862 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 273/546] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:23 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:23.952549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.954160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.955319 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bc89b311-5e63-4e75-b949-eff315d59290 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.232587 Jun 15 14:56:23.955860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 274/547] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:23 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:24.961872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:24.962433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:24.971307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.971823 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:24.972683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.973305 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:24.974156 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:24.974770 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:24.981738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.982186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:24.982963 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.983403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:25.180834 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.184002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.193113 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0d11467e-79c9-47f0-b743-0d163fcac39b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.235124 Jun 15 14:56:25.193630 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.193986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 274/548] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:24 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:25.195407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.196624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c84e67ff-3181-433d-adec-f820dbf747c9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.226338 Jun 15 14:56:25.197177 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 275/549] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:24 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:26.210337 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:26.211141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:26.215049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:26.215748 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:26.217809 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.218254 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.219014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.219677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.222519 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.223478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.224305 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.224741 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.424939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.433907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-063badbf-04d0-4b38-aa2b-dac1d85c4661 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.227354 Jun 15 14:56:26.434483 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 275/550] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:26 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:26.439549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.449135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.450706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.451854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1db09abd-a3c6-426d-ab65-64b2fc87a1cb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.241036 Jun 15 14:56:26.452433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 276/551] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:26 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:27.451297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:27.451671 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:27.458078 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.458529 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.459301 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.459741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.471297 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:27.472223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:27.479206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.479653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.480479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.480917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.671534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.680506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-32b19788-29d9-482e-80b1-7436b4af6dff tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.233501 Jun 15 14:56:27.681092 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 276/552] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:27 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:27.684620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.693378 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.694837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.695988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8ea5b23e-f72e-49d6-a94d-87403888d473 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.229057 Jun 15 14:56:27.696594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 277/553] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:27 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:28.703310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:28.703922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:28.711285 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.711739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.712540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.712979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.714321 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:28.714980 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:28.721758 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.722209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.723001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.723462 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.999677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:29.007350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:29.010776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-408be2cc-81fb-41d8-9d70-41bca8696cca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.311294 Jun 15 14:56:29.011545 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 277/554] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:28 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:29.017382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:29.018923 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:29.021373 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-47b33488-305b-4aab-89ee-7d31ba217f50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.309916 Jun 15 14:56:29.022245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 278/555] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:28 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:29.897643 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-4378ba10-c1d9-40c8-a0a6-965605cff304 req-75ab3b0c-71ab-4af7-bd6a-15dadb6cf43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdd536d-6f70-49a7-81e9-5a8d9a874132", "name": "network-vif-plugged", "status": "completed", "tag": "63af79cd-c2b3-45e8-8480-b3fcb4df3beb"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:29.907388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-4378ba10-c1d9-40c8-a0a6-965605cff304 req-75ab3b0c-71ab-4af7-bd6a-15dadb6cf43b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:29.907882 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-4378ba10-c1d9-40c8-a0a6-965605cff304 req-75ab3b0c-71ab-4af7-bd6a-15dadb6cf43b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:29.922113 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-4378ba10-c1d9-40c8-a0a6-965605cff304 req-75ab3b0c-71ab-4af7-bd6a-15dadb6cf43b service nova] Creating event network-vif-plugged:63af79cd-c2b3-45e8-8480-b3fcb4df3beb for instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 on hv-cinder-78729 Jun 15 14:56:29.928900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-4378ba10-c1d9-40c8-a0a6-965605cff304 req-75ab3b0c-71ab-4af7-bd6a-15dadb6cf43b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090902 Jun 15 14:56:29.929499 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 278/556] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:30.029232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:30.029960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:30.037458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.037904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.038757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.039471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.052419 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:30.054470 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:30.065980 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.066435 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.067216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.068217 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.072990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:30.296201 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.303283 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.304651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2f0045aa-9fdd-47ac-910d-31a29726598f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.279282 Jun 15 14:56:30.305382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 279/557] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:30 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:30.312126 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.313647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.314815 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2a15d077-d8db-482f-b7e1-4909a6d7cc9e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.277656 Jun 15 14:56:30.315369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 279/558] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:30 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:30.365563 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-493d8d13-8ccd-4e54-874f-f4f798812fbf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:30.371716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-493d8d13-8ccd-4e54-874f-f4f798812fbf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.372210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-493d8d13-8ccd-4e54-874f-f4f798812fbf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.431621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-493d8d13-8ccd-4e54-874f-f4f798812fbf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Going to try to stop instance {{(pid=124659) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 14:56:30.685421 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-493d8d13-8ccd-4e54-874f-f4f798812fbf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action" status: 202 len: 0 microversion: 2.1 time: 0.323617 Jun 15 14:56:30.686033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 280/559] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:56:30 2022] POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:56:30.694560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:30.695198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:30.701455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.701869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.702633 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.704836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.834184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.842630 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-629d75af-6dfe-4ff9-9840-7c1907ceb81d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.152278 Jun 15 14:56:30.843092 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 280/560] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:30 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:31.323066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:31.323766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:31.331585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.332041 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.332490 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:31.332951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.333125 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:31.333352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.340426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.340876 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.341862 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.342369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.534158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.539039 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.548343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1db0062d-db01-4c71-b794-4785c497e195 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1734 microversion: 2.1 time: 0.230105 Jun 15 14:56:31.548968 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.550622 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.551891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9a2bfedc-6a69-4eb5-9e4b-6d7c23c543de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.223295 Jun 15 14:56:31.554260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 281/561] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:31 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:31.556817 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 281/562] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:31 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:31.860489 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:31.861094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:31.868341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.868787 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.869551 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.869991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.008461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.015994 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d8ded14f-ddd7-4438-a0c0-32d81ba38181 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.159387 Jun 15 14:56:32.016580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 282/563] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:31 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:32.571059 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:32.571720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:32.572147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:32.572248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:32.578555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.578778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.578933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.579228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.579674 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.579998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.580255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.580460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.784700 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.788601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.794619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d4dc0cde-44a0-4f8e-a7e1-f010e4ae374b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1714 microversion: 2.1 time: 0.227870 Jun 15 14:56:32.795208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 283/564] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:32 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1714 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:32.798104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.799732 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.800958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0f50477f-1d01-418f-9655-e4a2b3d146de tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.234687 Jun 15 14:56:32.801650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 282/565] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:32 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:32.853770 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:32.854277 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:32.860585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.861043 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.861828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.862274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.008369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] HTTP exception thrown: Cannot 'detach_volume' instance b916fb35-c3eb-4252-9420-c26effc3069f while it is in vm_state rescued Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Request method failure captured: Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments/b96c4276-9448-4552-abaf-ba083559aa45 HTTP/1.1 Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfGs03oh-7kSWYEU1WMxWuCiS0GOth0nCtL3a7M4Nu4Ptc6aA4SWz0jlPSSy-cea0qKebLVF_7YbJboLQvV4Ez2nhvOybApFnbmS35KDfFVMDoyjGvyfaKV90cRJB01Qx5v25Xft1YZm-QTfkqtINUpwcIMmaiiOa6JhzOC173v-UIQ Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:56:33.009997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: ee9df934d1cd461abbf9c3cd90a8fdda Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 14:56:33.011750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Cannot 'detach_volume' instance b916fb35-c3eb-4252-9420-c26effc3069f while it is in vm_state rescued Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'server_id': 'b916fb35-c3eb-4252-9420-c26effc3069f', 'id': 'b96c4276-9448-4552-abaf-ba083559aa45'} Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b916fb35-c3eb-4252-9420-c26effc3069f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:56:33.012531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b916fb35-c3eb-4252-9420-c26effc3069f while it is in vm_state rescued Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b916fb35-c3eb-4252-9420-c26effc3069f while it is in vm_state rescued Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:56:33.013919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Returning 409 to user: Cannot 'detach_volume' instance b916fb35-c3eb-4252-9420-c26effc3069f while it is in vm_state rescued {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:56:33.015175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b442e9f6-845e-41ac-8351-f7085f2b122b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments/b96c4276-9448-4552-abaf-ba083559aa45" status: 409 len: 152 microversion: 2.1 time: 0.162840 Jun 15 14:56:33.015175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 284/566] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 14:56:32 2022] DELETE /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments/b96c4276-9448-4552-abaf-ba083559aa45 => generated 152 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:56:33.021978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-96c07607-e5a6-4a08-8f47-1973e57a6a9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:33.030274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-96c07607-e5a6-4a08-8f47-1973e57a6a9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.030274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96c07607-e5a6-4a08-8f47-1973e57a6a9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.030274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96c07607-e5a6-4a08-8f47-1973e57a6a9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.030773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96c07607-e5a6-4a08-8f47-1973e57a6a9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.031342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96c07607-e5a6-4a08-8f47-1973e57a6a9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.035027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:33.035680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.043279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.043753 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.044578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.045020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.219685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.233642 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f22494d1-d15d-407a-996f-885235a252a6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.202432 Jun 15 14:56:33.234216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 285/567] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:33 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:33.277360 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-96c07607-e5a6-4a08-8f47-1973e57a6a9e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "POST /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/action" status: 202 len: 0 microversion: 2.1 time: 0.260575 Jun 15 14:56:33.278229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 283/568] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:56:33 2022] POST /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:56:33.287125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:33.295026 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.295026 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.295371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.296173 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.296619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.312339 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:33.435525 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.444260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a94c68f8-d7c6-4a9d-9ee6-3d305cea9d77 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1722 microversion: 2.1 time: 0.161526 Jun 15 14:56:33.444948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 286/569] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:33 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:33.821521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:33.822237 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.828500 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.828950 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.829698 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.830139 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.961627 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.970071 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.971564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.972763 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-83199867-d3b1-4799-b4b6-ac3d20a1e3ba tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.156635 Jun 15 14:56:33.973711 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 284/570] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:33 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:34.251369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:34.251989 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:34.259971 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.260456 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.261236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.261679 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.408075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:34.416324 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-50a36f44-603f-483e-9511-639ebdda0dea tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.169130 Jun 15 14:56:34.416903 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 287/571] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:34 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:34.462194 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:34.462784 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:34.469314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.469775 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.470618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.471066 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.609090 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:34.617868 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-be40e226-665d-4744-adf5-fd24b7157c75 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1722 microversion: 2.1 time: 0.160178 Jun 15 14:56:34.618439 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 285/572] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:34 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:34.991846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:34.992479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:34.999044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.999503 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.000344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.000793 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.144347 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.153633 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.155162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.156352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-27e70140-47da-4e84-b44e-f3aaeca6307b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.169315 Jun 15 14:56:35.156901 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 288/573] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:34 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:35.434596 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:35.435289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:35.441754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.442203 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.443768 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.444433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.582754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.590704 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1703e8c8-4dcb-4fe5-8cca-59fe3a8a9f65 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.160025 Jun 15 14:56:35.591280 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 286/574] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:35 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:35.636309 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:35.636897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:35.643239 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.643688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.644501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.644938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.787968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.796563 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-45db4315-209c-4fed-8f97-05b55cdf35d0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1722 microversion: 2.1 time: 0.164157 Jun 15 14:56:35.797318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 289/575] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:35 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:36.175149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:36.175769 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.182966 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.183573 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.184286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.184732 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.319890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.328548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.330045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.331196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a7334806-848d-4305-8fd6-d62c57f6f76c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1809 microversion: 2.20 time: 0.160119 Jun 15 14:56:36.331813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 287/576] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:36 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:36.607687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:36.609320 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.614801 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.615268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.616051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.616499 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.815245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:36.816707 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.818817 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.824402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.824868 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.825650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.827959 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.829343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ae9fa85f-d211-4faf-aad5-6d9afc0f0ba1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.225393 Jun 15 14:56:36.830481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 290/577] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:36 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:37.072257 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.080273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b3a59f65-ffbc-4339-9cea-8788e60c3834 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1722 microversion: 2.1 time: 0.269175 Jun 15 14:56:37.080854 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 288/578] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:36 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:37.353413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:37.353413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:37.357222 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.357823 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.358660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.359256 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.491379 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.499867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.501423 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.502645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1210410a-8cdf-4869-985c-1f0f086378b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1796 microversion: 2.20 time: 0.157414 Jun 15 14:56:37.503201 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 291/579] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:37 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1796 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:37.847527 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:37.848188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:37.854416 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.854872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.855644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.856112 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.990518 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.998509 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5bb94478-e64b-48b4-a029-faec9aa91d7f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.154939 Jun 15 14:56:37.999104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 289/580] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:37 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:38.098223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:38.099350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:38.105986 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.106439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.107208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.107647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.239199 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:38.247809 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c3a13583-c88f-4a1b-bc7a-39e7b9de7d7d tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1722 microversion: 2.1 time: 0.153522 Jun 15 14:56:38.248409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 292/581] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:38 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:39.016399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:39.017013 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:39.024104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.024560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.025307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.025742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.156803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:39.165153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c773c9d3-2d25-44b7-bc3f-b2b56e3d226f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.152647 Jun 15 14:56:39.165722 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 290/582] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:39 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:39.265768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:39.267264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:39.276063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.276063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.276063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.276063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.414478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:39.422666 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f31b18e7-4a4e-41a2-9ebf-0af6878a3026 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1722 microversion: 2.1 time: 0.160790 Jun 15 14:56:39.423224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 293/583] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:39 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:40.182954 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:40.183566 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:40.190463 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.190909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.191666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.192121 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.321175 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:40.329568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a40a41e3-be75-4577-9fc0-0bc0c86426e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.150424 Jun 15 14:56:40.330146 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 291/584] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:40 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:40.439686 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:40.440322 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:40.447562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.448003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.448840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.449272 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.586906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:40.596546 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-10e17067-ecd4-43c6-87a0-1d1210127c41 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1722 microversion: 2.1 time: 0.161047 Jun 15 14:56:40.597123 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 294/585] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:40 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:41.346935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:41.347594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:41.354522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.354975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.355745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.356235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.488185 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:41.497036 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-12d2b1b5-fddf-40c2-90bb-9721c5c95b05 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.153793 Jun 15 14:56:41.497914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 292/586] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:41 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:41.614799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:41.615415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:41.621951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.622391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.623148 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.623605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.759934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:41.768025 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-23dbed99-d983-43e2-830f-fc5dc40240bf tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1728 microversion: 2.1 time: 0.157263 Jun 15 14:56:41.768610 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 295/587] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:41 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:41.785369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-72ff0bdd-a3d8-45b3-948e-20fad4e9ae21 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:41.785859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-72ff0bdd-a3d8-45b3-948e-20fad4e9ae21 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:41.792209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72ff0bdd-a3d8-45b3-948e-20fad4e9ae21 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.792749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72ff0bdd-a3d8-45b3-948e-20fad4e9ae21 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.793515 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72ff0bdd-a3d8-45b3-948e-20fad4e9ae21 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.793948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-72ff0bdd-a3d8-45b3-948e-20fad4e9ae21 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.873560 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-72ff0bdd-a3d8-45b3-948e-20fad4e9ae21 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091874 Jun 15 14:56:41.874189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 293/588] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 14:56:41 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:42.515890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:42.517131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:42.522808 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.523312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.524103 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.524588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.745323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:42.753273 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7a7dbc0e-5949-4011-9dee-aea22dcc0b91 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.241538 Jun 15 14:56:42.753877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 296/589] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:42 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:42.899082 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-759f4071-03cf-4e40-a3dd-6c84687d330e req-6e255bab-c0e4-4563-8374-e71ea87a2eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b916fb35-c3eb-4252-9420-c26effc3069f", "tag": "f45bbbcc-04a2-400c-b903-fb83f3b2d61f"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:42.907764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-759f4071-03cf-4e40-a3dd-6c84687d330e req-6e255bab-c0e4-4563-8374-e71ea87a2eb7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.910041 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-759f4071-03cf-4e40-a3dd-6c84687d330e req-6e255bab-c0e4-4563-8374-e71ea87a2eb7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.922498 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-759f4071-03cf-4e40-a3dd-6c84687d330e req-6e255bab-c0e4-4563-8374-e71ea87a2eb7 service nova] Creating event network-changed:f45bbbcc-04a2-400c-b903-fb83f3b2d61f for instance b916fb35-c3eb-4252-9420-c26effc3069f on hv-cinder-78729 Jun 15 14:56:42.931252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-759f4071-03cf-4e40-a3dd-6c84687d330e req-6e255bab-c0e4-4563-8374-e71ea87a2eb7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037157 Jun 15 14:56:42.932061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 294/590] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:43.771374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:43.771990 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:43.778898 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.779345 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.780140 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.780575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.923675 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:43.931673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bde196c6-07f5-46aa-b984-a6a7d2a5d9b8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.164773 Jun 15 14:56:43.932291 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 297/591] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:43 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:44.947136 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-251bf20d-3ea1-451e-928c-5b2a6302d0e7 req-4643e65c-a58f-4f51-b41a-e1c9aad2b457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b916fb35-c3eb-4252-9420-c26effc3069f", "tag": "f45bbbcc-04a2-400c-b903-fb83f3b2d61f"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:44.948690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:44.949319 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:44.955633 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-251bf20d-3ea1-451e-928c-5b2a6302d0e7 req-4643e65c-a58f-4f51-b41a-e1c9aad2b457 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:44.955882 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:44.956076 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-251bf20d-3ea1-451e-928c-5b2a6302d0e7 req-4643e65c-a58f-4f51-b41a-e1c9aad2b457 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:44.956370 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:44.957144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:44.957579 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:44.967492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-251bf20d-3ea1-451e-928c-5b2a6302d0e7 req-4643e65c-a58f-4f51-b41a-e1c9aad2b457 service nova] Creating event network-changed:f45bbbcc-04a2-400c-b903-fb83f3b2d61f for instance b916fb35-c3eb-4252-9420-c26effc3069f on hv-cinder-78729 Jun 15 14:56:44.972504 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-251bf20d-3ea1-451e-928c-5b2a6302d0e7 req-4643e65c-a58f-4f51-b41a-e1c9aad2b457 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029836 Jun 15 14:56:44.973135 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 295/592] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:45.120638 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:45.128203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d41c37e6-0f88-4ff6-b94d-0e373186dc13 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.183396 Jun 15 14:56:45.128775 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 298/593] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:44 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:46.147292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:46.148023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:46.154508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.154959 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:46.155711 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.156167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:46.171269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:46.292984 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:46.300717 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-531780c4-5d9e-4b8c-bba4-79ab7d320ea2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.157996 Jun 15 14:56:46.301320 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 296/594] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:46 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:47.319171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:47.319773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:47.326282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:47.326723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:47.327517 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:47.327948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:47.456809 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:47.464892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-031e0177-bb3d-4de6-bb3a-8fd5f47b076e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.150160 Jun 15 14:56:47.465578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 299/595] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:47 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:48.482766 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:48.483367 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:48.490210 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:48.490662 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:48.491434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:48.491876 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:48.624838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:48.633163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4c0eae10-4104-4092-a003-2ad8a70dce79 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.154370 Jun 15 14:56:48.633731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 297/596] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:48 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:49.651427 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:49.652035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:49.659122 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:49.659567 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:49.660382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:49.660815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:49.806262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:49.812639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-497a45af-7bfd-45d6-843e-63e1cb468618 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.165035 Jun 15 14:56:49.813362 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 300/597] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:49 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:50.830933 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:50.831502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:50.838762 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:50.839211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:50.839975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:50.840443 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:50.968412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:50.976053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-65390510-f3bc-442e-a3ce-5c9f0eeed441 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.149056 Jun 15 14:56:50.976648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 298/598] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:50 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:51.993961 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:51.994513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:52.001201 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:52.001657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:52.002424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:52.002892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:52.104333 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 14:56:52.105159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 14:56:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 14:56:52.137909 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:52.145468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9ef1c80b-5752-442f-adef-6e0f9f7b764d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.156000 Jun 15 14:56:52.146037 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 301/599] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:51 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:53.163404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:53.164179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:53.170956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.171499 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.172299 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.172792 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.313122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:53.320684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5562ecb3-c056-433e-abf7-0b7e10ca8e03 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.161754 Jun 15 14:56:53.321234 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 299/600] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:53 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:54.337978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:54.338594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:54.340912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=56 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:54.346171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.346622 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.347587 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.347934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.486632 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:54.495574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f94eb3f8-7aaf-4a0b-842f-f2406f520203 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.161561 Jun 15 14:56:54.496164 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 302/601] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:54 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:55.513065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:55.513689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:55.515995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=54 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:55.520751 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.521199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.521951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.522384 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.657384 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:55.665304 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6bf55a28-8b26-46c8-9c28-2cda9afa5b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.156178 Jun 15 14:56:55.665888 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 300/602] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:55 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:56.688363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:56.688899 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:56.695968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.696446 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.697217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.697675 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.700288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:56.825784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:56.837848 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-af94f5aa-1a9a-4ed2-954a-802870500e6e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1678 microversion: 2.1 time: 0.153398 Jun 15 14:56:56.838456 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 303/603] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:56 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:57.856067 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:57.856632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:57.862975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.863419 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:57.864225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.864666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:58.002201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:58.009892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f265b8f6-6834-4356-b2da-d6268dbf152b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1655 microversion: 2.1 time: 0.158200 Jun 15 14:56:58.010478 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 301/604] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:57 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:58.026764 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-674001b6-a4a9-4800-836d-c204628d4989 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:58.033382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-674001b6-a4a9-4800-836d-c204628d4989 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:58.033944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-674001b6-a4a9-4800-836d-c204628d4989 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:58.060855 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-674001b6-a4a9-4800-836d-c204628d4989 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Going to try to start instance {{(pid=124659) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 14:56:58.290205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-674001b6-a4a9-4800-836d-c204628d4989 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action" status: 202 len: 0 microversion: 2.1 time: 0.267631 Jun 15 14:56:58.296706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 304/605] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:56:58 2022] POST /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:56:58.299014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:58.299623 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:58.306430 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:58.307023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:58.307732 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:58.308215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:58.449068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:58.459350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4f8e91a7-3273-430d-83d4-b5c5af5ab744 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1664 microversion: 2.1 time: 0.164208 Jun 15 14:56:58.460683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 302/606] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:58 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:59.478054 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:59.479266 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:59.486336 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:59.486785 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:59.487641 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:59.488037 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:59.646344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:59.654331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bd6819eb-ac7a-4a20-85f2-97c1643bfa24 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1664 microversion: 2.1 time: 0.181060 Jun 15 14:56:59.654896 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 305/607] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:59 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:00.673531 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:00.674140 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:00.680804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:00.681247 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:00.682198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:00.682634 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:00.820011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:00.827860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2d60d661-d6c4-4a62-9b72-62679de1da27 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1668 microversion: 2.1 time: 0.158558 Jun 15 14:57:00.828492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 303/608] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:00 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:14.209653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-25738287-622e-4739-a0f8-509766c4adc7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:14.210851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-25738287-622e-4739-a0f8-509766c4adc7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:14.213532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=7 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:14.214287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:14.219035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25738287-622e-4739-a0f8-509766c4adc7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:14.219486 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25738287-622e-4739-a0f8-509766c4adc7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:14.220291 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25738287-622e-4739-a0f8-509766c4adc7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:14.220731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25738287-622e-4739-a0f8-509766c4adc7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:14.525607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-25738287-622e-4739-a0f8-509766c4adc7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.320111 Jun 15 14:57:14.530819 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 306/609] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:57:14 2022] POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:57:14.536212 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:14.536824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:14.540903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=7 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:14.542056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=45 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:14.545595 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:14.546043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:14.546811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:14.547246 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:14.699005 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:14.707433 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-30c7a3f6-04ff-42d4-9b73-f4c449688956 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1751 microversion: 2.1 time: 0.175058 Jun 15 14:57:14.708008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 304/610] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:14 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:15.725343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:15.726128 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:15.734747 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:15.735192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:15.735951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:15.736416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:15.880979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:15.890437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8cba08f8-9833-44a1-a54d-284a86b81808 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.169407 Jun 15 14:57:15.891000 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 307/611] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:15 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:16.913622 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:16.913622 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:16.915452 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:16.915905 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:16.916717 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:16.917162 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:17.071122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:17.081341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5e5faa5b-82ad-4802-940a-a99af04162aa tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.177568 Jun 15 14:57:17.081892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 305/612] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:16 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:18.097954 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:18.098569 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:18.105717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:18.106168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:18.106929 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:18.107368 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:18.249892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:18.258159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-92318dee-04b6-43be-84a7-3cb68bd5d24c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.164010 Jun 15 14:57:18.261598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 308/613] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:18 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:19.274572 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:19.275199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:19.281866 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:19.282322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:19.283102 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:19.283550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:19.426865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:19.435554 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cb4c122b-d060-44ab-a1e3-dab0e40e5691 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.164937 Jun 15 14:57:19.436136 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 306/614] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:19 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:20.453045 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:20.453672 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:20.460759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:20.461205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:20.461969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:20.462407 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:20.604874 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:20.612722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-24d206c6-f66b-4179-84b0-10875f96aa41 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.163543 Jun 15 14:57:20.613488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 309/615] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:20 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:21.631089 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:21.631731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:21.638391 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:21.638930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:21.639697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:21.640148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:21.785875 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:21.793962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-86b74cb6-b188-43a0-9616-2d98b0e4eb95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.167041 Jun 15 14:57:21.794523 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 307/616] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:21 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:22.812377 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:22.812983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:22.819635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:22.820074 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:22.820999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:22.821399 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:22.969914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:22.978137 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ab019b2f-88a5-4cf5-b07c-d8e15595159f tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.169600 Jun 15 14:57:22.978656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 310/617] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:22 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:23.995702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:23.996346 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:24.002839 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:24.003292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:24.004356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:24.004804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:24.150262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:24.158463 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0376639c-ac7a-49fb-9af4-ad74ab02da58 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.167313 Jun 15 14:57:24.159169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 308/618] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:23 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:25.175578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:25.176245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:25.183502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:25.183950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:25.184753 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:25.185190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:25.335055 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:25.343778 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-35598267-c71f-428d-bbc5-089ffa5f538e tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.172165 Jun 15 14:57:25.344380 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 311/619] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:25 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:26.360492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:26.361046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:26.367590 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:26.368039 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:26.369548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:26.369982 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:26.517631 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:26.526418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2605c79c-3499-4365-b89c-85893afd5f8c tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.170071 Jun 15 14:57:26.527083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 309/620] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:26 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:27.544294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:27.544913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:27.551090 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:27.551541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:27.552339 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:27.552782 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:27.691700 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:27.700461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b1cbf5c4-0c1a-4dae-bc34-574b766f87e9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.161298 Jun 15 14:57:27.701029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 312/621] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:27 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:28.717551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:28.718157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:28.724783 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.725256 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.726014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.726445 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.871742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:28.880124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-dda8fd4e-872c-40e8-8b97-8983297b3b3b tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.166485 Jun 15 14:57:28.880683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 310/622] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:28 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:29.896243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:29.896857 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:29.904003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:29.904470 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:29.905226 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:29.905658 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:30.048438 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:30.056404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c95c4353-7f26-4011-a226-710a885d3444 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.164154 Jun 15 14:57:30.057092 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 313/623] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:29 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:31.074523 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:31.075142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:31.081908 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:31.082360 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:31.083172 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:31.083618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:31.228393 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:31.237707 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-af168f13-18b9-465a-8df7-dc0bee12aef9 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.167404 Jun 15 14:57:31.238289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 311/624] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:31 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:32.255163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:32.255711 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:32.262592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.270829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:32.270829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.270829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:32.406678 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:32.414935 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-50952cea-34c3-467d-9fe3-c16e3ddd4bd0 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.163971 Jun 15 14:57:32.415600 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 314/625] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:32 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:33.432915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:33.433522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:33.439975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:33.440454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:33.441215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:33.441655 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:33.592391 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:33.600473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0b5e97ba-3fd3-487e-9902-4323496b6a83 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.172302 Jun 15 14:57:33.601042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 312/626] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:33 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:34.617088 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:34.617696 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:34.624644 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.625088 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.625874 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.626308 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.771861 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:34.777578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-63b193ad-7302-459e-81e0-1fb9c89b82c6 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.164279 Jun 15 14:57:34.778216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 315/627] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:34 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:35.795609 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:35.796260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:35.802782 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.803234 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:35.804001 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.804518 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:35.947738 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:35.955875 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cce073f7-b708-4fb9-86ce-610270b01d85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1756 microversion: 2.1 time: 0.164916 Jun 15 14:57:35.956468 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 313/628] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:35 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:36.973105 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:36.973713 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:36.980976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:36.981449 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:36.982253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:36.982691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:37.136424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:37.145125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-567e0b30-a54e-45a1-b613-223d0c312fd1 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1759 microversion: 2.1 time: 0.175831 Jun 15 14:57:37.145797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 316/629] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:36 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:57.853963 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=20 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:57.853963 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=60 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:57.961340 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3a7e046c-8a28-462e-9598-2cf904aec340 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:57.961832 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3a7e046c-8a28-462e-9598-2cf904aec340 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:57.968796 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a7e046c-8a28-462e-9598-2cf904aec340 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.969236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a7e046c-8a28-462e-9598-2cf904aec340 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.970005 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a7e046c-8a28-462e-9598-2cf904aec340 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.970438 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a7e046c-8a28-462e-9598-2cf904aec340 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.001702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3a7e046c-8a28-462e-9598-2cf904aec340 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments/d6493d8a-24e2-45e5-916d-93eebe8af00a" status: 200 len: 194 microversion: 2.20 time: 0.154384 Jun 15 14:57:58.002278 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 314/630] 10.222.0.42 () {60 vars in 1453 bytes} [Wed Jun 15 14:57:57 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments/d6493d8a-24e2-45e5-916d-93eebe8af00a => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:57:58.066272 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:58.066816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:58.069062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=22 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:58.069716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:58.074483 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.078460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.078460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.078460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.160034 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'services' on Instance uuid 7cdd536d-6f70-49a7-81e9-5a8d9a874132 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:57:58.465505 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2a3a7024-7a25-40af-9a50-58efe876cbb4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments/d6493d8a-24e2-45e5-916d-93eebe8af00a" status: 202 len: 0 microversion: 2.20 time: 0.402848 Jun 15 14:57:58.466026 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 317/631] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jun 15 14:57:58 2022] DELETE /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments/d6493d8a-24e2-45e5-916d-93eebe8af00a => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:57:58.474741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2b4bd68a-1d55-4244-8337-260f83aac9b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:58.475727 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2b4bd68a-1d55-4244-8337-260f83aac9b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:58.481831 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b4bd68a-1d55-4244-8337-260f83aac9b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.482293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b4bd68a-1d55-4244-8337-260f83aac9b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.483142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b4bd68a-1d55-4244-8337-260f83aac9b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.483638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2b4bd68a-1d55-4244-8337-260f83aac9b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.514280 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2b4bd68a-1d55-4244-8337-260f83aac9b2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043639 Jun 15 14:57:58.515473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 315/632] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jun 15 14:57:58 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:57:59.527357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-093bdd86-ed75-47d7-b7cf-5e0250b140ae tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:59.528458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-093bdd86-ed75-47d7-b7cf-5e0250b140ae tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:59.535625 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-093bdd86-ed75-47d7-b7cf-5e0250b140ae tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:59.536068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-093bdd86-ed75-47d7-b7cf-5e0250b140ae tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.536849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-093bdd86-ed75-47d7-b7cf-5e0250b140ae tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:59.537284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-093bdd86-ed75-47d7-b7cf-5e0250b140ae tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.571797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-093bdd86-ed75-47d7-b7cf-5e0250b140ae tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049197 Jun 15 14:57:59.572392 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 318/633] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jun 15 14:57:59 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:58:00.583839 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fe33e775-9f1f-4e96-adeb-2b490bf3cee9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:00.584777 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fe33e775-9f1f-4e96-adeb-2b490bf3cee9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:00.591492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fe33e775-9f1f-4e96-adeb-2b490bf3cee9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.591939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fe33e775-9f1f-4e96-adeb-2b490bf3cee9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.592750 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fe33e775-9f1f-4e96-adeb-2b490bf3cee9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.593203 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fe33e775-9f1f-4e96-adeb-2b490bf3cee9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.623333 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fe33e775-9f1f-4e96-adeb-2b490bf3cee9 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043555 Jun 15 14:58:00.623889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 316/634] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jun 15 14:58:00 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:00.682159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:00.682865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:00.690373 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.694343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.694343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.694343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.720417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:01.032342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-01837a76-859c-4db2-b8ae-73deace0fbf5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 204 len: 0 microversion: 2.20 time: 0.353662 Jun 15 14:58:01.039205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 319/635] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jun 15 14:58:00 2022] DELETE /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:58:01.041486 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:01.042100 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:01.049047 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.049488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.050264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.050696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.194895 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:01.203660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:01.205231 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:01.206413 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ba6dbd21-1039-47f5-ba08-ea4c1d191259 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.169009 Jun 15 14:58:01.206974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 317/636] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:01 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:01.918572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:01.919161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:01.926725 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.927176 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.927942 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.928416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.010464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'services' on Instance uuid b916fb35-c3eb-4252-9420-c26effc3069f {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:02.225064 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:02.225688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:02.232580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.233021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.234833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.235275 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.260301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-083e2d63-e55f-4127-9d66-82126ed844ca tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments/b96c4276-9448-4552-abaf-ba083559aa45" status: 202 len: 0 microversion: 2.1 time: 0.345749 Jun 15 14:58:02.261063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 320/637] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 14:58:01 2022] DELETE /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments/b96c4276-9448-4552-abaf-ba083559aa45 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:02.270911 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2b0d4195-1c0e-430f-b5bb-b694817402c1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:02.272155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2b0d4195-1c0e-430f-b5bb-b694817402c1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:02.278676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b0d4195-1c0e-430f-b5bb-b694817402c1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.279131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b0d4195-1c0e-430f-b5bb-b694817402c1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.279901 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b0d4195-1c0e-430f-b5bb-b694817402c1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.280891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b0d4195-1c0e-430f-b5bb-b694817402c1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.311598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2b0d4195-1c0e-430f-b5bb-b694817402c1 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045616 Jun 15 14:58:02.312496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 321/638] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:02 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:02.375914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:02.384462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:02.386008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:02.387165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6f025b17-7d66-472d-bcfe-6dc9e5d2d33a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.166105 Jun 15 14:58:02.387734 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 318/639] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:02 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:02.984593 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:02.985250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:02.991988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.992519 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.993298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.993859 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.017440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lazy-loading 'flavor' on Instance uuid 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:03.323079 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2508a216-0858-44f2-9e46-a5fe31fdb697 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:03.323979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2508a216-0858-44f2-9e46-a5fe31fdb697 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:03.330936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2508a216-0858-44f2-9e46-a5fe31fdb697 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.331332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2508a216-0858-44f2-9e46-a5fe31fdb697 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.332125 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2508a216-0858-44f2-9e46-a5fe31fdb697 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.332570 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2508a216-0858-44f2-9e46-a5fe31fdb697 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.339215 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-07651091-c54d-4aac-9c70-830b2ccd01de tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "POST /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80/action" status: 202 len: 0 microversion: 2.1 time: 0.358589 Jun 15 14:58:03.339904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 322/640] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:58:02 2022] POST /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:03.349534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:03.350329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:03.357528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.358112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.358985 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.359404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.517122 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:03.524828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-189d6f6e-5dec-465d-84aa-3e05fd1df629 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.180109 Jun 15 14:58:03.529837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2508a216-0858-44f2-9e46-a5fe31fdb697 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210764 Jun 15 14:58:03.534563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 319/641] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:03 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:03.540020 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:03.540183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 323/642] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:03 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:03.540967 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:03.547999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.548555 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.549344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.549771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.689089 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:03.697449 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:03.699030 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:03.700229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a2080887-ba3c-4a55-af63-553a76ce4abb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.164433 Jun 15 14:58:03.700779 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 320/643] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:03 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:04.542856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:04.543485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1e2b088e-ebae-4cb8-b5a0-e9e35c3a86b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:04.543866 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:04.543971 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1e2b088e-ebae-4cb8-b5a0-e9e35c3a86b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:04.551317 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e2b088e-ebae-4cb8-b5a0-e9e35c3a86b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.553673 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.553673 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.553863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e2b088e-ebae-4cb8-b5a0-e9e35c3a86b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.553863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e2b088e-ebae-4cb8-b5a0-e9e35c3a86b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.554046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.554124 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1e2b088e-ebae-4cb8-b5a0-e9e35c3a86b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.554212 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.583902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1e2b088e-ebae-4cb8-b5a0-e9e35c3a86b0 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044838 Jun 15 14:58:04.584496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 324/644] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:04 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:04.690430 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.697973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-af272070-157c-45ff-a16f-b8172fa368af tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.158993 Jun 15 14:58:04.698529 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 321/645] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:04 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:04.718580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:04.719241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:04.725323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.725766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.726529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.726962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.855235 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.863976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.865551 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.866714 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e89c770d-5823-4225-a345-02f70a408d25 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1724 microversion: 2.20 time: 0.151994 Jun 15 14:58:04.867266 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 325/646] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:04 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:05.596125 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c87f8750-31bb-4926-b26e-9aeddc237d61 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:05.597199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c87f8750-31bb-4926-b26e-9aeddc237d61 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:05.603843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c87f8750-31bb-4926-b26e-9aeddc237d61 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.604330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c87f8750-31bb-4926-b26e-9aeddc237d61 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.605115 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c87f8750-31bb-4926-b26e-9aeddc237d61 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.605556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c87f8750-31bb-4926-b26e-9aeddc237d61 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.644593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c87f8750-31bb-4926-b26e-9aeddc237d61 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052693 Jun 15 14:58:05.646621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 322/647] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:05 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:05.714876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:05.715483 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:05.724173 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.724905 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.725682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.726114 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.886112 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:05.886766 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:05.893251 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.893701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.894728 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.895351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.213452 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.221725 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d213d022-e29a-412b-81bd-88e634641324 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.510718 Jun 15 14:58:06.231964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 326/648] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:05 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:06.232468 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.239731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.241276 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.242441 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5f7dcff9-0e2b-49e6-a3f2-692406c3c6b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1656 microversion: 2.20 time: 0.360683 Jun 15 14:58:06.242993 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 323/649] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:05 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1656 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:06.316241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-ab62b0ac-b210-4dd1-bdde-253b7d7031ba req-e63d9a60-6963-456c-b6f8-0fc354d576c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdd536d-6f70-49a7-81e9-5a8d9a874132", "name": "network-vif-deleted", "tag": "63af79cd-c2b3-45e8-8480-b3fcb4df3beb"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:06.324787 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-ab62b0ac-b210-4dd1-bdde-253b7d7031ba req-e63d9a60-6963-456c-b6f8-0fc354d576c4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.330235 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-ab62b0ac-b210-4dd1-bdde-253b7d7031ba req-e63d9a60-6963-456c-b6f8-0fc354d576c4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.337717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-ab62b0ac-b210-4dd1-bdde-253b7d7031ba req-e63d9a60-6963-456c-b6f8-0fc354d576c4 service nova] Creating event network-vif-deleted:63af79cd-c2b3-45e8-8480-b3fcb4df3beb for instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 on hv-cinder-78729 Jun 15 14:58:06.342942 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-ab62b0ac-b210-4dd1-bdde-253b7d7031ba req-e63d9a60-6963-456c-b6f8-0fc354d576c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 Jun 15 14:58:06.343645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 327/650] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:06.657557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fa50e260-980c-4714-be46-200864ac52e7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:06.658905 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fa50e260-980c-4714-be46-200864ac52e7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:06.665531 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa50e260-980c-4714-be46-200864ac52e7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.666107 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa50e260-980c-4714-be46-200864ac52e7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.666887 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa50e260-980c-4714-be46-200864ac52e7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.667327 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa50e260-980c-4714-be46-200864ac52e7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.697573 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fa50e260-980c-4714-be46-200864ac52e7 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044048 Jun 15 14:58:06.698132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 324/651] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:06 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:58:06.787461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:06.787991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:06.800688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.801145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.801973 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.802825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.833146 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:06.847618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:07.239644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:07.240313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:07.246450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.247329 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.248248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.248786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.258362 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-994cd87e-fa55-4ea4-bbfc-c9578836b2ac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 204 len: 0 microversion: 2.1 time: 0.473510 Jun 15 14:58:07.264366 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 328/652] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:58:06 2022] DELETE /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:07.275433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:07.276937 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:07.290570 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.291712 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.293601 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.296152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.391760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.392617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.393463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'fault' on Instance uuid 7cdd536d-6f70-49a7-81e9-5a8d9a874132 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:07.474948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.475145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.479344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b1c336b0-9de7-46b6-95b1-66b0ab1268e6 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.243606 Jun 15 14:58:07.479914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 325/653] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:07 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:07.480139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.481862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.483185 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f36af562-af44-45e8-a346-7c4435de3693 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1371 microversion: 2.20 time: 0.220406 Jun 15 14:58:07.484006 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 329/654] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:07 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:07.489672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:07.490547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:07.497302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.497818 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.498605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.499037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.654564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.662945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-89c5b9e5-e445-4e67-baad-a630e62cae3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1688 microversion: 2.1 time: 0.181611 Jun 15 14:58:07.667401 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 326/655] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:07 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:08.499034 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:08.499877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:08.503304 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:08.503919 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:08.507396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.511609 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.511609 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.511609 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.511928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.511928 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.512882 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.513344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.551764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.552136 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.552595 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'fault' on Instance uuid 7cdd536d-6f70-49a7-81e9-5a8d9a874132 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:08.624965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.635455 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.637273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.638600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9c3f7f8c-113b-412c-bbee-bf0c1f323488 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1371 microversion: 2.20 time: 0.140465 Jun 15 14:58:08.639363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 327/656] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:08 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:08.683166 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:08.684701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:08.694681 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.695278 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.696259 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.696805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.710119 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.719225 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e84db4bd-4a67-4fc7-9383-522038a39114 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.224063 Jun 15 14:58:08.720594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 330/657] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:08 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:08.850404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.857879 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1a1c2bf3-4714-462c-88a2-6e1b4e15bea9 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1688 microversion: 2.1 time: 0.180456 Jun 15 14:58:08.858423 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 328/658] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:08 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:09.657789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:09.658750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:09.665529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.665981 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.666756 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.667196 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.700126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.700581 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.701033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'fault' on Instance uuid 7cdd536d-6f70-49a7-81e9-5a8d9a874132 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:09.736548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:09.737173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:09.744881 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.745624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:09.746137 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.746137 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.746666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.755653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:09.757247 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:09.758605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fcba9c16-db28-4be0-9b36-60aafedba62b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1371 microversion: 2.20 time: 0.104916 Jun 15 14:58:09.759416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 331/659] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:09 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:09.874870 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:09.875627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:09.882842 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.883304 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.884108 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.884559 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.885479 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:09.894143 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b3bcc8bf-67a3-4679-835e-80a3d4553a36 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.161424 Jun 15 14:58:09.894715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 329/660] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:09 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:10.014300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.022255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8c5fb1f4-e5c7-4fd1-b033-daa2723ae0c8 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1688 microversion: 2.1 time: 0.151301 Jun 15 14:58:10.022819 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 332/661] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:09 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:10.778000 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:10.778610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:10.785150 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:10.785683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:10.786448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:10.786884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:10.790867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:10.818407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:10.818776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:10.819231 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'fault' on Instance uuid 7cdd536d-6f70-49a7-81e9-5a8d9a874132 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:10.864017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.872555 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.874088 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.875242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fd1f1089-c360-4987-8714-d48f827802cd tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 200 len: 1371 microversion: 2.20 time: 0.101283 Jun 15 14:58:10.875793 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 330/662] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:10 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:10.911687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:10.912465 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:10.919325 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:10.919768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:10.920579 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:10.921018 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.039180 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:11.042645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:11.046026 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.046481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.047247 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.047680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.065218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:11.078812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ced93e56-392f-4bde-b941-c57795df6f01 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.171405 Jun 15 14:58:11.079461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 333/663] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:10 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:11.186069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:11.199616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4e85be21-0b5f-42e7-b277-42ae9cad068a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1688 microversion: 2.1 time: 0.164756 Jun 15 14:58:11.200198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 331/664] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:11 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:11.894009 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:11.895016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:11.901627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.902076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.902849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.903289 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.921933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] HTTP exception thrown: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Request method failure captured: Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 HTTP/1.1 Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfIpuwCOEV1p06_tr2itxtCl5afRcUPMoieiLU8Gq_0YgL3G6IsdjX69qw_aWoZuYWEIO1MGJp1elBBGBk28WY9gRH59P2YCkuJJ_LaGdexy0imuciHCBJM7RqBmurcjl_Saq4bfHaxdPopdcuJR2v9xG-fQw-PWdVennHn2Fyvl4uE Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:58:11.923592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 2dcc02eb960e45b99587438aa3696f40 Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 14:58:11.925409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '7cdd536d-6f70-49a7-81e9-5a8d9a874132'} Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:11.926573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 14:58:11.927872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:11.929169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Returning 404 to user: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:11.929169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e9179a80-87c6-40bc-97ca-066eadd3b465 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 404 len: 111 microversion: 2.20 time: 0.035266 Jun 15 14:58:11.929169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 334/665] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:11 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 14:58:11.936327 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-67a7e867-24b1-4864-993e-52ef1f56e3fe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '.version_select at 0x7fb8a83b1310>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:12.029655 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-67a7e867-24b1-4864-993e-52ef1f56e3fe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102436053" status: 204 len: 0 microversion: 2.20 time: 0.098007 Jun 15 14:58:12.030244 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 332/666] 10.222.0.42 () {60 vars in 1258 bytes} [Wed Jun 15 14:58:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102436053 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 14:58:12.095385 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:12.096026 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:12.102549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.102991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.103760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.104242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.215962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:12.216674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:12.223654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.228159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.228159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.228159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.254686 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:12.262476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-19e052aa-64f9-4bd0-bbe1-9038218eea5a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.170976 Jun 15 14:58:12.263076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 335/667] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:12 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:12.444653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:12.452999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8705d872-6b1f-48bc-a558-a8ded7302beb tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1688 microversion: 2.1 time: 0.240879 Jun 15 14:58:12.462923 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 333/668] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:12 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:12.984480 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-179d7908-dc12-491f-a1d4-75114b98c46f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'create', calling method: .version_select at 0x7fb8accbd8b0>, body: {"keypair": {"name": "tempest-keypair-1770540482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKbquFSDQPvZ7PO1NJdheJSg9kj1sSX+2qefHNeD1KUjfcCUfGPkVXhTACGJQtx5GXHM03Xz1v0XpGKxXpZYGja1IlGEY1rzC1FC5qb7LtSCpnckdwwXLMksUi33t119A=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:12.999734 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-179d7908-dc12-491f-a1d4-75114b98c46f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for project f9c28220b6ea4db99f81a37e0794450b. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:13.004553 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-179d7908-dc12-491f-a1d4-75114b98c46f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for user 2dcc02eb960e45b99587438aa3696f40 and project f9c28220b6ea4db99f81a37e0794450b. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:13.144224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-179d7908-dc12-491f-a1d4-75114b98c46f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.163618 Jun 15 14:58:13.144830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 336/669] 10.222.0.42 () {62 vars in 1199 bytes} [Wed Jun 15 14:58:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 14:58:13.283746 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:13.288529 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:13.295154 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.295498 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.296326 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.296770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.354461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-3af199e4-4328-42a8-97f2-841698100f95 req-bbf8ca0c-c9f0-4610-93ce-207377fb2c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b916fb35-c3eb-4252-9420-c26effc3069f", "name": "network-vif-deleted", "tag": "f45bbbcc-04a2-400c-b903-fb83f3b2d61f"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:13.367090 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3af199e4-4328-42a8-97f2-841698100f95 req-bbf8ca0c-c9f0-4610-93ce-207377fb2c42 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.367789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-3af199e4-4328-42a8-97f2-841698100f95 req-bbf8ca0c-c9f0-4610-93ce-207377fb2c42 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.389337 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-3af199e4-4328-42a8-97f2-841698100f95 req-bbf8ca0c-c9f0-4610-93ce-207377fb2c42 service nova] Creating event network-vif-deleted:f45bbbcc-04a2-400c-b903-fb83f3b2d61f for instance b916fb35-c3eb-4252-9420-c26effc3069f on hv-cinder-78729 Jun 15 14:58:13.397881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-3af199e4-4328-42a8-97f2-841698100f95 req-bbf8ca0c-c9f0-4610-93ce-207377fb2c42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047444 Jun 15 14:58:13.398615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 337/670] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:13.471310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:13.472720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:13.495019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.495568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.498070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.503568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.570259 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.583206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-12dafee1-a741-4ed2-a573-76b1f72bc84e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.307616 Jun 15 14:58:13.592539 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 334/671] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:13 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:13.647474 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.655941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-794641c7-231a-4b13-8a6c-7d3069816bac tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1330 microversion: 2.1 time: 0.188887 Jun 15 14:58:13.656877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 338/672] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:13 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1330 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:14.602997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:14.604275 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:14.611288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.611736 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.615762 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.615762 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.676024 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:14.676916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:14.689932 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.692472 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.695336 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.695890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.748408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.749002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.749535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid b916fb35-c3eb-4252-9420-c26effc3069f {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:14.841069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.855080 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2b2828de-c6df-463e-9616-9d8d3fc03306 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1335 microversion: 2.1 time: 0.185346 Jun 15 14:58:14.856596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 339/673] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:14 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1335 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:14.928366 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.941116 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-307685ef-d500-4488-8a24-0dae0aaa784f tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.343627 Jun 15 14:58:14.945273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 335/674] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:14 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:15.875480 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:15.876135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:15.886221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.886686 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.887507 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.887950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.923529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.923992 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.924492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid b916fb35-c3eb-4252-9420-c26effc3069f {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:15.944473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1299303162", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "321d9204-351d-4464-9bb3-7cb5dc9d97e0"}], "security_groups": [{"name": "tempest-securitygroup--1709830699"}], "key_name": "tempest-keypair-1770540482", "user_data": "}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:15.973629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:15.981872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b67a154e-f72e-47c0-ab86-af6b348bbbe2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 200 len: 1335 microversion: 2.1 time: 0.110394 Jun 15 14:58:15.982456 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 340/675] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:15 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:15.986986 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:15.991381 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:15.999898 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.000482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.001665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.002240 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.091886 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] validate_networks() for [('321d9204-351d-4464-9bb3-7cb5dc9d97e0', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:58:16.226528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:16.234473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3be2d3b1-c63f-4295-b426-98344dae2536 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.250997 Jun 15 14:58:16.235082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 341/676] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:15 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:16.682024 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:58:16.682460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:58:16.683064 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:58:16.683388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:58:16.683680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:58:16.693758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.694341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.695235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.695675 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.714070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for project f9c28220b6ea4db99f81a37e0794450b. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:16.718052 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Getting quotas for user 2dcc02eb960e45b99587438aa3696f40 and project f9c28220b6ea4db99f81a37e0794450b. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:16.731344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:58:16.735745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:58:16.871296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7bbcf107-81bf-4682-b451-eaf2778c7e7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.931273 Jun 15 14:58:16.871941 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 336/677] 10.222.0.42 () {62 vars in 1187 bytes} [Wed Jun 15 14:58:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 15 14:58:16.883358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1889b0a0-6958-4c0b-9fa3-dba57f5cfa1b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:16.883970 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1889b0a0-6958-4c0b-9fa3-dba57f5cfa1b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:16.942617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1889b0a0-6958-4c0b-9fa3-dba57f5cfa1b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:16.950020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1889b0a0-6958-4c0b-9fa3-dba57f5cfa1b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:16.952118 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1889b0a0-6958-4c0b-9fa3-dba57f5cfa1b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:16.952705 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1889b0a0-6958-4c0b-9fa3-dba57f5cfa1b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1282 microversion: 2.20 time: 0.074539 Jun 15 14:58:16.953268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 342/678] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:16 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:16.999289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:17.000577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b916fb35-c3eb-4252-9420-c26effc3069f] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:17.012563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.012563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.012563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.012563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.026715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] HTTP exception thrown: Instance b916fb35-c3eb-4252-9420-c26effc3069f could not be found. Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Request method failure captured: Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f HTTP/1.1 Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGs03oh-7kSWYEU1WMxWuCiS0GOth0nCtL3a7M4Nu4Ptc6aA4SWz0jlPSSy-cea0qKebLVF_7YbJboLQvV4Ez2nhvOybApFnbmS35KDfFVMDoyjGvyfaKV90cRJB01Qx5v25Xft1YZm-QTfkqtINUpwcIMmaiiOa6JhzOC173v-UIQ Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:58:17.028601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: ee9df934d1cd461abbf9c3cd90a8fdda Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance b916fb35-c3eb-4252-9420-c26effc3069f could not be found. Jun 15 14:58:17.030714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'b916fb35-c3eb-4252-9420-c26effc3069f'} Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b916fb35-c3eb-4252-9420-c26effc3069f could not be found. Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:17.031791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b916fb35-c3eb-4252-9420-c26effc3069f could not be found. Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b916fb35-c3eb-4252-9420-c26effc3069f could not be found. Jun 15 14:58:17.033017 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:17.035568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Returning 404 to user: Instance b916fb35-c3eb-4252-9420-c26effc3069f could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:17.035568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6cf8d1f6-2016-4638-b065-e8da0e0f4d40 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f" status: 404 len: 111 microversion: 2.1 time: 0.035271 Jun 15 14:58:17.035568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 337/679] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:16 2022] GET /compute/v2.1/servers/b916fb35-c3eb-4252-9420-c26effc3069f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:17.039273 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3f595fbc-bba2-4fd6-a130-e427173a8106 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '.version_select at 0x7fb8acc68040>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:17.147890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3f595fbc-bba2-4fd6-a130-e427173a8106 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650655407" status: 202 len: 0 microversion: 2.1 time: 0.112431 Jun 15 14:58:17.148546 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 343/680] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jun 15 14:58:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650655407 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:17.257781 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:17.258483 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:17.264682 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.265312 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.266180 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.266692 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.430489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:17.438596 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bb9345e3-ac87-49c9-bbe6-29744ba9a079 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.188982 Jun 15 14:58:17.450659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 338/681] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:17 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:17.972671 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:17.973464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:17.980406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.980867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.981646 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.982092 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.051627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.060081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.061562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.062696 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-df058534-c96a-4be7-8ffd-47df32b89e1f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1286 microversion: 2.20 time: 0.095486 Jun 15 14:58:18.063263 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 344/682] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:17 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:18.459917 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:18.461611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:18.468488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.468939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.470406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.470966 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.622741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.631580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d8d3e77d-a558-4353-a44e-5edf245380a7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1569 microversion: 2.1 time: 0.177011 Jun 15 14:58:18.632197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 339/683] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:18 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:18.656809 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9b386dd9-1155-4e49-9392-2dd0bd9d9476 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:18.657591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9b386dd9-1155-4e49-9392-2dd0bd9d9476 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:18.664965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b386dd9-1155-4e49-9392-2dd0bd9d9476 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.665451 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b386dd9-1155-4e49-9392-2dd0bd9d9476 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.666213 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b386dd9-1155-4e49-9392-2dd0bd9d9476 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.666643 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9b386dd9-1155-4e49-9392-2dd0bd9d9476 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.854278 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9b386dd9-1155-4e49-9392-2dd0bd9d9476 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "POST /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80/action" status: 202 len: 0 microversion: 2.1 time: 0.203279 Jun 15 14:58:18.855341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 345/684] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:58:18 2022] POST /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:18.865252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:18.865252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:18.872383 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.872383 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.872677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.873097 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:19.041014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:19.050367 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5f1fc58b-e655-4376-bf61-9fa808f934b5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1577 microversion: 2.1 time: 0.190222 Jun 15 14:58:19.056221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 340/685] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:18 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:19.081640 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:19.084972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:19.089203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:19.089665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:19.090431 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:19.090867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:19.095565 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:19.167121 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:19.175648 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:19.177245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:19.178461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a2ad3f70-0d85-4154-834d-5459e0a90790 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1334 microversion: 2.20 time: 0.100801 Jun 15 14:58:19.183868 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 346/686] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:19 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:20.068526 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:20.069364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:20.076628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.077106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.077901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.078340 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.198669 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:20.199764 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:20.211493 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.212844 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.217182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.217182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.318627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.330244 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.332059 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.333252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8748e1a9-5ad0-4a9c-a7bd-e3517b0368c3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1340 microversion: 2.20 time: 0.138480 Jun 15 14:58:20.334500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 347/687] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:20 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1340 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:20.336915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.339802 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-b31557a9-07c9-441e-aa7b-47bab0414e41 req-2b36668f-3cf4-4954-9aa4-7dc276e7b81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5cf910-fe77-4ed2-9851-6b5a45f93c80", "name": "network-vif-unplugged", "status": "completed", "tag": "5b0dddd1-2896-4186-9fd4-38e802bca5a6"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:20.348730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:20.351125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b31557a9-07c9-441e-aa7b-47bab0414e41 req-2b36668f-3cf4-4954-9aa4-7dc276e7b81f service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.354897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-233bc3d2-e26c-4e2f-8bb4-2a545d4530b8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1519 microversion: 2.1 time: 0.287511 Jun 15 14:58:20.355038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b31557a9-07c9-441e-aa7b-47bab0414e41 req-2b36668f-3cf4-4954-9aa4-7dc276e7b81f service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.355149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 341/688] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:20 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:20.365388 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.compute.server_external_events [req-b31557a9-07c9-441e-aa7b-47bab0414e41 req-2b36668f-3cf4-4954-9aa4-7dc276e7b81f service nova] Unable to find a host for instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80. Dropping event network-vif-unplugged {{(pid=124659) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 14:58:20.366798 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-b31557a9-07c9-441e-aa7b-47bab0414e41 req-2b36668f-3cf4-4954-9aa4-7dc276e7b81f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030887 Jun 15 14:58:20.367927 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 348/689] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 15 14:58:20.618245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:20.619049 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:20.627650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.630697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.631777 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.632477 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.666344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Going to try to terminate instance {{(pid=124660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:21.000286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-62cda1ae-aea1-4cb7-8b03-5d926a27b14b tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "DELETE /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 204 len: 0 microversion: 2.1 time: 0.388330 Jun 15 14:58:21.001265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 342/690] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:58:20 2022] DELETE /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:21.012781 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.013611 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.022575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.023109 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.023977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.024639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.235172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.243944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9bfe5e13-c91d-48bd-a608-0bae4d931c79 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1508 microversion: 2.1 time: 0.236208 Jun 15 14:58:21.244585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 349/691] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:21.374406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.377485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.381604 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.383302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.394328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.395130 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.396002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.396595 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.404692 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.404692 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.404692 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.405966 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.970280 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.977812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.983785 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.983785 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.984702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-24eb7549-e2ff-4c1c-9075-a56c34cdf4bf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.617469 Jun 15 14:58:21.985679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 343/692] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:21.988954 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a409f68e-5cd9-4c4b-84ac-948752660b80 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1519 microversion: 2.1 time: 0.616450 Jun 15 14:58:21.990652 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 350/693] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1519 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:22.165291 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-e9106278-8740-4365-bea8-24d92fd33c67 req-97e3fe3b-5986-4360-a60b-be1c2cf94fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb410306-baba-4584-9def-e17d53db3ce4", "tag": "64b622a1-14da-45ed-a6c9-adcf5f16d5aa"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:22.181100 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e9106278-8740-4365-bea8-24d92fd33c67 req-97e3fe3b-5986-4360-a60b-be1c2cf94fba service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.181695 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e9106278-8740-4365-bea8-24d92fd33c67 req-97e3fe3b-5986-4360-a60b-be1c2cf94fba service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.201090 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-e9106278-8740-4365-bea8-24d92fd33c67 req-97e3fe3b-5986-4360-a60b-be1c2cf94fba service nova] Creating event network-changed:64b622a1-14da-45ed-a6c9-adcf5f16d5aa for instance bb410306-baba-4584-9def-e17d53db3ce4 on hv-cinder-78729 Jun 15 14:58:22.206757 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-e9106278-8740-4365-bea8-24d92fd33c67 req-97e3fe3b-5986-4360-a60b-be1c2cf94fba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044728 Jun 15 14:58:22.207367 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 344/694] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:22.263541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:22.264820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:22.273269 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.274401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.275612 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.276475 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.435477 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:22.445772 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-50a93455-0d93-4aea-9cb3-ce725a1d2993 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1508 microversion: 2.1 time: 0.186429 Jun 15 14:58:22.446392 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 351/695] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:22 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:23.013735 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:23.014397 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:23.014826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:23.014972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:23.022374 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.022821 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.023669 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.023804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.024143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.024279 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.025219 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.025829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.355158 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.392898 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.397296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.398040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.398302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3a8b9340-e5be-4331-9531-e9a3a1d6106b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.388779 Jun 15 14:58:23.399140 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 345/696] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:23 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:23.439475 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7005cddc-5b98-4358-929c-e40498a54cbf tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.428678 Jun 15 14:58:23.440193 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 352/697] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:23 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:23.479028 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:23.480621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:23.498745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.500006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.502340 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.505126 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.651708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.666062 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ac9ee211-a500-4405-942d-df23df441803 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1466 microversion: 2.1 time: 0.198072 Jun 15 14:58:23.667128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 346/698] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:23 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1466 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:24.222379 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-faf221f9-d86f-4546-a03f-3a47ba76706c req-deecce54-f73a-4149-8c1a-1ad118e5a29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408e1d57-c792-4ac6-9112-a83dfc0cab85", "name": "network-vif-deleted", "tag": "3bdc7e34-f0cd-4840-88cb-77a1a31e769f"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:24.230667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-faf221f9-d86f-4546-a03f-3a47ba76706c req-deecce54-f73a-4149-8c1a-1ad118e5a29c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.231117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-faf221f9-d86f-4546-a03f-3a47ba76706c req-deecce54-f73a-4149-8c1a-1ad118e5a29c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.243453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-faf221f9-d86f-4546-a03f-3a47ba76706c req-deecce54-f73a-4149-8c1a-1ad118e5a29c service nova] Creating event network-vif-deleted:3bdc7e34-f0cd-4840-88cb-77a1a31e769f for instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 on hv-cinder-78729 Jun 15 14:58:24.248471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-faf221f9-d86f-4546-a03f-3a47ba76706c req-deecce54-f73a-4149-8c1a-1ad118e5a29c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030027 Jun 15 14:58:24.249095 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 353/699] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:24.427883 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:24.428550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:24.435258 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.435716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.436535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.436980 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.462428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:24.463825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:24.470624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.471049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.472292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.473063 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.643785 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.647342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:24.652557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.654178 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.655293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-46b79d2b-1ffb-4cc0-b9c8-b415a7d2465e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.233142 Jun 15 14:58:24.655849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 347/700] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:24 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:24.656835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.665487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5ae1fde8-6847-4838-849e-b55020bc6869 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.208189 Jun 15 14:58:24.666052 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 354/701] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:24 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:24.684427 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:24.685065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:24.691020 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.691460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.692243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.692676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.719446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:24.723427 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.723872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.724347 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid 408e1d57-c792-4ac6-9112-a83dfc0cab85 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:24.769011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.776826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7d008fd3-b918-44c2-8518-178052bc5ab4 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1311 microversion: 2.1 time: 0.096165 Jun 15 14:58:24.777383 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 348/702] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:24 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:25.673717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:25.674333 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.681596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.682044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.682818 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.683287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.683508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:25.684145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.691815 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.692295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.693060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.693492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.875869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.884958 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.886509 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.887658 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c51f7c3c-f7fc-4ec0-ab08-6f2b47e9bccf tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.217900 Jun 15 14:58:25.888207 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 355/703] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:25 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:25.892713 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:25.893420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.895105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.900030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.900515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.901354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.902061 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.903511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b37bcfbf-37b9-4de7-a05e-cacf07f7d52d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.224823 Jun 15 14:58:25.904236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 349/704] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:25 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:25.934153 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.934598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.935044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid 408e1d57-c792-4ac6-9112-a83dfc0cab85 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:25.980331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.988894 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-183a89d5-9637-4a4f-8901-f936fd07b082 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1311 microversion: 2.1 time: 0.099658 Jun 15 14:58:25.989458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 356/705] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:25 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:26.907164 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:26.907757 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:26.909932 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:26.910802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:26.915840 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.921855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.921855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.921855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.926091 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:26.926990 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:26.933175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.933587 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.934353 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.934794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.951061 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:27.130889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:27.139349 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:27.139496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:27.140976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:27.142105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ef0bce23-c6ee-4e87-8b30-cb8f9ff8e3a1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.238921 Jun 15 14:58:27.142689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 350/706] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:26 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:27.148414 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:27.148575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f8d299fa-6709-4896-8751-a435e94f2a7e tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.226107 Jun 15 14:58:27.148848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:27.152935 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 357/707] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:26 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:27.155729 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.156219 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.156998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.157492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.189061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.189510 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.189958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid 408e1d57-c792-4ac6-9112-a83dfc0cab85 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:27.246816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:27.255853 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-079b3ccf-ce1a-4621-b292-1e9d8511b886 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1311 microversion: 2.1 time: 0.111399 Jun 15 14:58:27.256464 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 351/708] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:27 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:28.159302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.160716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.165420 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.166065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.167631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.167980 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.168797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.169254 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.172891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.173353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.174142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.174584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.366079 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.369307 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.374148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cb23657b-a742-4872-95ec-8f5f104baa1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.212399 Jun 15 14:58:28.377348 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:28 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:28.379408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.381117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.382500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bddf7b63-819e-4e5d-afb2-81cff2765d9b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.227164 Jun 15 14:58:28.382843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.383466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.383741 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 358/710] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:28 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:28.389915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.390494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.391376 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.391924 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.430386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.431197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.431678 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid 408e1d57-c792-4ac6-9112-a83dfc0cab85 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:28.479975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.489226 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7788c4d3-15e8-444d-a0a5-41222793d169 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 200 len: 1311 microversion: 2.1 time: 0.109339 Jun 15 14:58:28.490198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 353/711] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:28 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:29.391192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.391731 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.400229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.400679 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.401463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.402708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.402848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.403421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.413658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.414494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.415955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.416769 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.661772 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.666514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.678811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.680424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-83e438bd-fc3b-4852-a684-902cfa7d5c7c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.292764 Jun 15 14:58:29.681731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.683871 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b0c870a0-a78e-44dd-914e-563c7996a1c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.284629 Jun 15 14:58:29.694119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 354/712] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:29 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:29.694322 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 359/713] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:29 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:29.694448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.696389 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: 408e1d57-c792-4ac6-9112-a83dfc0cab85] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.704356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.707466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.707466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.707466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.721759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] HTTP exception thrown: Instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 could not be found. Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Request method failure captured: Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 HTTP/1.1 Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGs03oh-7kSWYEU1WMxWuCiS0GOth0nCtL3a7M4Nu4Ptc6aA4SWz0jlPSSy-cea0qKebLVF_7YbJboLQvV4Ez2nhvOybApFnbmS35KDfFVMDoyjGvyfaKV90cRJB01Qx5v25Xft1YZm-QTfkqtINUpwcIMmaiiOa6JhzOC173v-UIQ Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:58:29.724141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: ee9df934d1cd461abbf9c3cd90a8fdda Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 could not be found. Jun 15 14:58:29.726481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '408e1d57-c792-4ac6-9112-a83dfc0cab85'} Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 could not be found. Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:29.727225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 could not be found. Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 could not be found. Jun 15 14:58:29.728567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:29.729724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Returning 404 to user: Instance 408e1d57-c792-4ac6-9112-a83dfc0cab85 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:29.729724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6c78c37c-cfaa-4abb-abd2-22a61462a0b2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85" status: 404 len: 111 microversion: 2.1 time: 0.039299 Jun 15 14:58:29.729724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 355/714] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:29 2022] GET /compute/v2.1/servers/408e1d57-c792-4ac6-9112-a83dfc0cab85 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:29.737796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.738833 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.745146 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.745640 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.746446 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.746889 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.776417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:30.101320 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e3d13002-457f-4416-a85b-c860bd9ea80a tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 204 len: 0 microversion: 2.1 time: 0.367743 Jun 15 14:58:30.102196 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 360/715] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:58:29 2022] DELETE /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:30.110982 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:30.111598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:30.119468 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.119930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.120737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.121187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.264108 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.273024 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-37f125af-4e21-409a-a6f8-b18ea6e7ddfe tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.166365 Jun 15 14:58:30.274021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 356/716] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:30 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:30.703676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:30.704409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:30.708428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:30.709204 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:30.712362 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.712816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.713593 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.714031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.716079 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.716575 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.717350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.719127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.906557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.915150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.915422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.916685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.917809 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d7327b4e-ce6f-4083-a9e1-1f46cbfe138f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.218470 Jun 15 14:58:30.918383 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 361/717] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:30 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:30.923352 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4019367b-26fa-4fec-8f3b-6639e72567f8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.220909 Jun 15 14:58:30.924582 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 357/718] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:30 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:31.173774 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-8a609389-8b5f-4520-bf9e-b3f5c2a58a95 req-4cb0e007-598b-4a75-a52a-54e8f51d957e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb410306-baba-4584-9def-e17d53db3ce4", "name": "network-vif-plugged", "status": "completed", "tag": "64b622a1-14da-45ed-a6c9-adcf5f16d5aa"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:31.183426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-8a609389-8b5f-4520-bf9e-b3f5c2a58a95 req-4cb0e007-598b-4a75-a52a-54e8f51d957e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.183869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-8a609389-8b5f-4520-bf9e-b3f5c2a58a95 req-4cb0e007-598b-4a75-a52a-54e8f51d957e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.188276 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:31.195917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-8a609389-8b5f-4520-bf9e-b3f5c2a58a95 req-4cb0e007-598b-4a75-a52a-54e8f51d957e service nova] Creating event network-vif-plugged:64b622a1-14da-45ed-a6c9-adcf5f16d5aa for instance bb410306-baba-4584-9def-e17d53db3ce4 on hv-cinder-78729 Jun 15 14:58:31.201242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-8a609389-8b5f-4520-bf9e-b3f5c2a58a95 req-4cb0e007-598b-4a75-a52a-54e8f51d957e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Jun 15 14:58:31.201854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 362/719] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:31.293056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.293670 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.299739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.300261 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.301625 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.302063 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.375290 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-288d0065-0c42-42d6-90c4-f0a3e8338fa3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.376443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-288d0065-0c42-42d6-90c4-f0a3e8338fa3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.384539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-288d0065-0c42-42d6-90c4-f0a3e8338fa3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.384539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-288d0065-0c42-42d6-90c4-f0a3e8338fa3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.385030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-288d0065-0c42-42d6-90c4-f0a3e8338fa3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.385469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-288d0065-0c42-42d6-90c4-f0a3e8338fa3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.415374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-288d0065-0c42-42d6-90c4-f0a3e8338fa3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044719 Jun 15 14:58:31.415953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 363/720] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 14:58:31.442838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:31.451184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1f10d14e-5dfa-41e2-8766-5235ca95aed2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1521 microversion: 2.1 time: 0.161916 Jun 15 14:58:31.451779 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:31.477380 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.477893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.484599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.485057 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.485831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.486272 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.522916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:58:31.803171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-290beb8a-2c9a-4099-8f88-e01817c2e777 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 204 len: 0 microversion: 2.1 time: 0.330550 Jun 15 14:58:31.804572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 364/722] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:58:31 2022] DELETE /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:31.817390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.818868 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.830502 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.831065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.832008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.832505 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.938770 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.939622 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.947719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.953329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.953329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.953329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.061264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.069795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3d7b63db-2b24-4b9a-8fb5-e40c23525136 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1674 microversion: 2.1 time: 0.260322 Jun 15 14:58:32.070390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 359/723] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1674 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:32.085166 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:32.085789 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:32.093620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.094075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.094854 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.095297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.234610 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.244920 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.246628 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.247728 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-febf1556-9cc3-4f2a-bb79-a1b7d4982a88 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.315226 Jun 15 14:58:32.248535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 365/724] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:32.260683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-a8956149-a3f0-4b8d-a008-9f8580adaa62 req-4e187402-fd71-4329-a099-ff10bb310622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65023b0-7f40-4b7f-85e5-91006b438f4c", "name": "network-vif-deleted", "tag": "a43bc32e-bbcc-488c-a3f5-3300379c6a9c"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:32.274038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a8956149-a3f0-4b8d-a008-9f8580adaa62 req-4e187402-fd71-4329-a099-ff10bb310622 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.274422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a8956149-a3f0-4b8d-a008-9f8580adaa62 req-4e187402-fd71-4329-a099-ff10bb310622 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.287043 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-a8956149-a3f0-4b8d-a008-9f8580adaa62 req-4e187402-fd71-4329-a099-ff10bb310622 service nova] Creating event network-vif-deleted:a43bc32e-bbcc-488c-a3f5-3300379c6a9c for instance b65023b0-7f40-4b7f-85e5-91006b438f4c on hv-cinder-78729 Jun 15 14:58:32.292039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-a8956149-a3f0-4b8d-a008-9f8580adaa62 req-4e187402-fd71-4329-a099-ff10bb310622 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036779 Jun 15 14:58:32.293084 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 366/725] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:32.311406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.319850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5de440e7-0f26-4180-a8c8-d7602c08c68c tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.239045 Jun 15 14:58:32.320684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 360/726] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:32 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:32.469483 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:32.470072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:32.477296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.477744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.478510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.478943 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.555623 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.563424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-95cd8c96-c56a-4102-8fcc-98c625cf480f tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1479 microversion: 2.1 time: 0.098273 Jun 15 14:58:32.563995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 367/727] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:32 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1479 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:33.087776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.088472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.095149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.095598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.096394 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.096871 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.233990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.242426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a45e5c2-1a85-44b1-be93-8b11ce98803b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1674 microversion: 2.1 time: 0.158484 Jun 15 14:58:33.243004 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 361/728] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:33.265963 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.266579 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.273391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.273844 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.274619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.275058 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.337901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.338438 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.344449 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.344909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.345699 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.346139 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.443668 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.452878 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.454874 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.456001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cf4a7b9c-4bce-4b4c-a26f-2bcfca1537f6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1408 microversion: 2.20 time: 0.193947 Jun 15 14:58:33.457136 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 368/729] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:33.508396 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.516007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-999a439a-6f23-4258-b539-bdad34ebb512 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.182062 Jun 15 14:58:33.516618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 362/730] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:33.582767 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.583789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.593443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.594177 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.595568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.596476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.667362 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.677049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-42cd9c27-f11b-4abe-a22e-4f293b61c457 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1479 microversion: 2.1 time: 0.098887 Jun 15 14:58:33.677624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 369/731] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1479 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:34.259569 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.260214 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.266951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.267408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.268199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.268640 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.413358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.421585 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a92331b4-108a-4697-8982-37d2c3588a39 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1674 microversion: 2.1 time: 0.165837 Jun 15 14:58:34.422218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 363/732] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:34.479454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.480189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.486863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.487310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.489529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.489660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.533530 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.534222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.541723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.542146 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.542934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.543375 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.548054 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:34.683240 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.693404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.695014 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.696451 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5688028e-3d64-4465-aa84-ebe6f31bce4c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1600 microversion: 2.20 time: 0.220917 Jun 15 14:58:34.697145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 370/733] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1600 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:34.702568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.703174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.709758 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.710203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.710978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.711715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.714170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.721818 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3b1caf08-33bf-49ab-9c09-7a826283fee8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.192580 Jun 15 14:58:34.723152 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 364/734] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:34.729856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-14d64fed-253c-45e3-b8bb-88aba7d52bea tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.730577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-14d64fed-253c-45e3-b8bb-88aba7d52bea tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.739127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d64fed-253c-45e3-b8bb-88aba7d52bea tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.739714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d64fed-253c-45e3-b8bb-88aba7d52bea tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.740650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d64fed-253c-45e3-b8bb-88aba7d52bea tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.741195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d64fed-253c-45e3-b8bb-88aba7d52bea tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.743673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.744146 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.744594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid b65023b0-7f40-4b7f-85e5-91006b438f4c {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:34.797890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.805822 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ce357db6-9ae0-4532-9cbb-a4972794ab3e tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1311 microversion: 2.1 time: 0.107521 Jun 15 14:58:34.806398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 371/735] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:34.841355 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-14d64fed-253c-45e3-b8bb-88aba7d52bea tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116916 Jun 15 14:58:34.841986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 365/736] 10.222.0.42 () {60 vars in 1315 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:58:35.440374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:35.442255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:35.448467 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.448924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.449707 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.450149 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.680577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.688252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8b136199-1fa2-42e7-a618-3c4ccff17735 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1674 microversion: 2.1 time: 0.251835 Jun 15 14:58:35.688825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 372/737] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:35 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:35.741823 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:35.742848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:35.749315 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.749773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.752323 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.752323 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.822941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:35.823665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:35.829651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.830121 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.830869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.831461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.864577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.865039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.865508 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid b65023b0-7f40-4b7f-85e5-91006b438f4c {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:35.971677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.979606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-72ac9ed4-ab36-4654-867e-2de666180f43 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1311 microversion: 2.1 time: 0.160574 Jun 15 14:58:35.980188 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 373/738] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:35 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:36.016236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:36.024421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d0e304cb-2e68-4c64-ab0a-3172beef0cd8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.287558 Jun 15 14:58:36.025009 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 366/739] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:35 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:36.306131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-ff5c0923-7501-48e8-bcb3-b840ef520f3d req-6aea6503-2c68-4f99-add0-1137c1f802f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb410306-baba-4584-9def-e17d53db3ce4", "tag": "64b622a1-14da-45ed-a6c9-adcf5f16d5aa"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:36.315544 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-ff5c0923-7501-48e8-bcb3-b840ef520f3d req-6aea6503-2c68-4f99-add0-1137c1f802f0 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.317233 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-ff5c0923-7501-48e8-bcb3-b840ef520f3d req-6aea6503-2c68-4f99-add0-1137c1f802f0 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.330223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-ff5c0923-7501-48e8-bcb3-b840ef520f3d req-6aea6503-2c68-4f99-add0-1137c1f802f0 service nova] Creating event network-changed:64b622a1-14da-45ed-a6c9-adcf5f16d5aa for instance bb410306-baba-4584-9def-e17d53db3ce4 on hv-cinder-78729 Jun 15 14:58:36.335550 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-ff5c0923-7501-48e8-bcb3-b840ef520f3d req-6aea6503-2c68-4f99-add0-1137c1f802f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033012 Jun 15 14:58:36.336224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 374/740] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:36.706032 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:36.706663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:36.712858 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.713314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.714105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.714535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.862467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:36.870657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-676779da-f737-4ddd-a3c9-af6c8b9b8eaf tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1674 microversion: 2.1 time: 0.168431 Jun 15 14:58:36.871352 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 367/741] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:36 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:36.998735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:36.999611 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:37.007655 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.008232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.009312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.009773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.044281 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:37.045744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:37.047473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.048298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.048829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lazy-loading 'fault' on Instance uuid b65023b0-7f40-4b7f-85e5-91006b438f4c {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:37.054793 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.055503 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.057820 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.058563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.122605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9df934d1cd461abbf9c3cd90a8fdda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b356eba3587e481aa04f99bcb2194b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.133735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-74f17a19-0523-4e7a-bea5-69f7ab9b4822 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 200 len: 1311 microversion: 2.1 time: 0.139889 Jun 15 14:58:37.134342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 375/742] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:36 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:37.338887 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.348939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-99c34236-1d8a-440f-9d5b-a4fc460a434b tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.310110 Jun 15 14:58:37.349835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 368/743] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:37 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:37.889226 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:37.889786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:37.897107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.897718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.898690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.899283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.991510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.999849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a9b7182a-cb1d-4669-8b86-0eb12869b09f tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1606 microversion: 2.1 time: 0.114598 Jun 15 14:58:38.006290 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 376/744] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:37 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1606 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:38.154688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:38.155956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] [instance: b65023b0-7f40-4b7f-85e5-91006b438f4c] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:38.164514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.165246 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.166055 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.166476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.186277 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] HTTP exception thrown: Instance b65023b0-7f40-4b7f-85e5-91006b438f4c could not be found. Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Request method failure captured: Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c HTTP/1.1 Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGs03oh-7kSWYEU1WMxWuCiS0GOth0nCtL3a7M4Nu4Ptc6aA4SWz0jlPSSy-cea0qKebLVF_7YbJboLQvV4Ez2nhvOybApFnbmS35KDfFVMDoyjGvyfaKV90cRJB01Qx5v25Xft1YZm-QTfkqtINUpwcIMmaiiOa6JhzOC173v-UIQ Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:58:38.189663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b356eba3587e481aa04f99bcb2194b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: b356eba3587e481aa04f99bcb2194b11 Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1076848050 Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: ee9df934d1cd461abbf9c3cd90a8fdda Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1076848050-project Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance b65023b0-7f40-4b7f-85e5-91006b438f4c could not be found. Jun 15 14:58:38.192260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'b65023b0-7f40-4b7f-85e5-91006b438f4c'} Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65023b0-7f40-4b7f-85e5-91006b438f4c could not be found. Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:38.193771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65023b0-7f40-4b7f-85e5-91006b438f4c could not be found. Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65023b0-7f40-4b7f-85e5-91006b438f4c could not be found. Jun 15 14:58:38.195033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:38.196987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] Returning 404 to user: Instance b65023b0-7f40-4b7f-85e5-91006b438f4c could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:38.196987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-250732be-3c5b-416c-b424-4c739a6f0fb2 tempest-ServerRescueNegativeTestJSON-1076848050 tempest-ServerRescueNegativeTestJSON-1076848050-project] 10.222.0.42 "GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c" status: 404 len: 111 microversion: 2.1 time: 0.042166 Jun 15 14:58:38.196987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 369/745] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:38 2022] GET /compute/v2.1/servers/b65023b0-7f40-4b7f-85e5-91006b438f4c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:38.353511 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-a15daf01-efd8-478d-b502-92b1e32b37db req-055c5bd2-f5fb-4a9b-9e56-2f6f31a028c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af1b5d3-7171-4426-b239-bc34951326cf", "name": "network-vif-deleted", "tag": "c77b9439-402e-4a93-afeb-ec23f099ae61"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:38.361663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a15daf01-efd8-478d-b502-92b1e32b37db req-055c5bd2-f5fb-4a9b-9e56-2f6f31a028c7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.363306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-a15daf01-efd8-478d-b502-92b1e32b37db req-055c5bd2-f5fb-4a9b-9e56-2f6f31a028c7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.367310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:38.369844 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:38.376562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.379386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.379386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.380059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.384547 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-a15daf01-efd8-478d-b502-92b1e32b37db req-055c5bd2-f5fb-4a9b-9e56-2f6f31a028c7 service nova] Creating event network-vif-deleted:c77b9439-402e-4a93-afeb-ec23f099ae61 for instance 9af1b5d3-7171-4426-b239-bc34951326cf on hv-cinder-78729 Jun 15 14:58:38.390391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-a15daf01-efd8-478d-b502-92b1e32b37db req-055c5bd2-f5fb-4a9b-9e56-2f6f31a028c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040346 Jun 15 14:58:38.391539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 377/746] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:38.899105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:38.908338 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-16431472-6985-432e-93d2-06378a109c1d tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.545366 Jun 15 14:58:38.910007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 370/747] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:38 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:39.020067 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:39.021743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:39.028639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.029378 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.030351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.031174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.077286 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.077972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.078603 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lazy-loading 'fault' on Instance uuid 9af1b5d3-7171-4426-b239-bc34951326cf {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:39.083136 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:39.180402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:39.189249 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-27339696-effb-42b6-a6c0-2a06b81988b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 200 len: 1327 microversion: 2.1 time: 0.174222 Jun 15 14:58:39.190551 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 378/748] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:39 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:39.927643 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:39.929139 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:39.936647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.937583 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.938543 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.939119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.169309 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:40.182363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3bc8e0bd-9faf-450f-8706-1da36c2d46ae tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.259586 Jun 15 14:58:40.184066 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 371/749] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:39 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:40.209842 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:40.210459 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:40.217554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:40.218276 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.219224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:40.219817 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.239075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] HTTP exception thrown: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Request method failure captured: Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf HTTP/1.1 Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfGqrgGokbV2c9gtSCqVCRsKr0d_vzUe0Lj7ZuxV26CeHtGfo2bpR7uz5BdE_f_AJXO4vbVVG_l2eQ9IG6StwlG_BOYoHQPE9V3GNSyoJ_mUpOkMCp8WmcebLNHeJt1mer2Ttqa2616gzyfP-u9VtuuVwNwKPtRoXqiHJzI6pa3FJPY Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:58:40.241303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeTestJSON-580381324 Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeTestJSON-580381324-project Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 0650eb65117a4e27908c4355bfc46c3b Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeTestJSON-580381324-project Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 14:58:40.242907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '9af1b5d3-7171-4426-b239-bc34951326cf'} Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:40.243804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 14:58:40.245457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:40.247706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Returning 404 to user: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:40.249133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c29c2dc1-e3b6-4ec3-96f9-15bd55361cfd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 404 len: 111 microversion: 2.1 time: 0.043985 Jun 15 14:58:40.249873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 379/750] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:40 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:58:40.258810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-30a0673b-dcac-49e4-a488-3d378ae9ae59 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '.version_select at 0x7fb8a84fb430>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:40.349628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-30a0673b-dcac-49e4-a488-3d378ae9ae59 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857062980" status: 202 len: 0 microversion: 2.1 time: 0.094647 Jun 15 14:58:40.353645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 372/751] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jun 15 14:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857062980 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:41.202768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:41.203400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:41.210739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.211479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.212219 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.212570 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.398826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-1bdaa38a-4da8-45a2-b7cc-600c9180bd0a req-c79e6ed4-f58d-4533-be9d-1f20b0cef9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5cf910-fe77-4ed2-9851-6b5a45f93c80", "name": "network-vif-plugged", "status": "completed", "tag": "5b0dddd1-2896-4186-9fd4-38e802bca5a6"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:41.412235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-1bdaa38a-4da8-45a2-b7cc-600c9180bd0a req-c79e6ed4-f58d-4533-be9d-1f20b0cef9cc service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.414859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-1bdaa38a-4da8-45a2-b7cc-600c9180bd0a req-c79e6ed4-f58d-4533-be9d-1f20b0cef9cc service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.425760 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-1bdaa38a-4da8-45a2-b7cc-600c9180bd0a req-c79e6ed4-f58d-4533-be9d-1f20b0cef9cc service nova] Creating event network-vif-plugged:5b0dddd1-2896-4186-9fd4-38e802bca5a6 for instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 on hv-cinder-78729 Jun 15 14:58:41.431386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-1bdaa38a-4da8-45a2-b7cc-600c9180bd0a req-c79e6ed4-f58d-4533-be9d-1f20b0cef9cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Jun 15 14:58:41.432671 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 373/752] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:41.509374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:41.518299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7309097f-e949-4de6-b76d-b4c7e29fddf7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.320277 Jun 15 14:58:41.519890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 380/753] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:41 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:41.817106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e9a46eac-a044-4db0-8187-4f4f27d43be2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'create', calling method: .version_select at 0x7fb8a83b1ca0>, body: {"keypair": {"name": "tempest-keypair-380515949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiJzpG7EmaYfWmw2f51yoEL3hahGemWTFcFrB1P5Sx1qlFbVxiJ9m1zUg9kVqpUh1wVIoGsqu8Bk4Se5e+I0//blCl6aILo4WJ8umFN24UUn6uc0FM/VBSQdi0t+5jZqw=="}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:41.833093 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-e9a46eac-a044-4db0-8187-4f4f27d43be2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:41.837429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-e9a46eac-a044-4db0-8187-4f4f27d43be2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for user 0650eb65117a4e27908c4355bfc46c3b and project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:41.935873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e9a46eac-a044-4db0-8187-4f4f27d43be2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122945 Jun 15 14:58:41.936743 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 374/754] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 14:58:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:42.536912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:42.537937 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:42.547912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.553485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.553485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.553485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.702301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:42.711332 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-68b473cc-8296-4471-a93d-90d15d260da7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.179717 Jun 15 14:58:42.712023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 381/755] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:42 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:43.735092 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:43.735092 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:43.741132 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.741580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.742883 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.743598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.973919 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:43.982033 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-817714d5-d8ae-4afa-8d4f-94d740a80808 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1575 microversion: 2.1 time: 0.254457 Jun 15 14:58:43.982611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 375/756] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:43 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1575 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:45.002983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:45.004524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:45.011717 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.012200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.012981 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.013422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.039317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1027638013", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db0cdacf-17d9-4e64-93e8-a444d0282468"}], "security_groups": [{"name": "tempest-securitygroup--1421383658"}], "key_name": "tempest-keypair-380515949", "user_data": "}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:45.201493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] validate_networks() for [('db0cdacf-17d9-4e64-93e8-a444d0282468', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:58:45.206725 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.215105 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6215bb6f-5eca-4ea1-a5d8-677f444b7281 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1562 microversion: 2.1 time: 0.218404 Jun 15 14:58:45.217507 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 382/757] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:44 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1562 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:45.602995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:58:45.602995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:58:45.602995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:58:45.602995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:58:45.602995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:58:45.607976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.608453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.609254 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.609705 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.628553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:45.632546 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Getting quotas for user 0650eb65117a4e27908c4355bfc46c3b and project 175b90b822a942bd8e04b8ad7d228a57. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:45.644149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:58:45.646428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:58:45.771306 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-05ac30e7-10e8-42ea-b1b4-a55984c44fae tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736603 Jun 15 14:58:45.772215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 376/758] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:58:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:58:45.782720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c56f96fc-7e25-45cc-8a0c-2107379bfab9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:45.783464 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c56f96fc-7e25-45cc-8a0c-2107379bfab9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:45.809531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-37f8dd82-ae3b-4cc7-9c1d-355210998a9a tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Action: 'create', calling method: .version_select at 0x7fb8acc03280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-303062222"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:45.855808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c56f96fc-7e25-45cc-8a0c-2107379bfab9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.862897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c56f96fc-7e25-45cc-8a0c-2107379bfab9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1237 microversion: 2.1 time: 0.084513 Jun 15 14:58:45.873231 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 377/759] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:45 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:46.563896 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-37f8dd82-ae3b-4cc7-9c1d-355210998a9a tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.881299 Jun 15 14:58:46.564605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 383/760] 10.222.0.42 () {60 vars in 1154 bytes} [Wed Jun 15 14:58:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 883 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 15 14:58:46.576034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b9d18862-4f7f-4aef-b58c-bf65e5aeff1a tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8367550>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:46.633425 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b9d18862-4f7f-4aef-b58c-bf65e5aeff1a tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 200 len: 344 microversion: 2.1 time: 0.061204 Jun 15 14:58:46.634038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 378/761] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:58:46 2022] GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:46.881369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:46.881969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:46.889672 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.890919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.891726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.892585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.959698 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.967553 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-01e5b5a6-91fb-49d1-b83c-2e86e9bc9512 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1241 microversion: 2.1 time: 0.090948 Jun 15 14:58:46.968136 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 384/762] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:46 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:47.647633 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-442978c3-e686-4af1-a314-31c1704d91ab tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8351f70>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.702701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-442978c3-e686-4af1-a314-31c1704d91ab tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 200 len: 344 microversion: 2.1 time: 0.059948 Jun 15 14:58:47.703302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 379/763] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:47.985492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.986274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:47.994079 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.994535 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.995321 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.995768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:48.060496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:48.068595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-60ba816c-6b77-4da3-8d99-92f852a32521 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1289 microversion: 2.1 time: 0.086938 Jun 15 14:58:48.069231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 385/764] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:48.716243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cd8f7909-5b25-48fe-9884-65817ae9f532 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a84da1f0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:48.770059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cd8f7909-5b25-48fe-9884-65817ae9f532 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 200 len: 345 microversion: 2.1 time: 0.053717 Jun 15 14:58:48.770059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 380/765] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:58:48 2022] GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:48.777943 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2d24da52-d114-4583-a732-8b172805a794 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Action: 'create', calling method: .version_select at 0x7fb8acc03670>, body: {"snapshot": {"volume_id": "bbe12488-d849-4248-856b-f44ab8cf2ceb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-294837760"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:49.087205 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:49.087819 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:49.095428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:49.096160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:49.097619 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:49.097897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:49.185822 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2d24da52-d114-4583-a732-8b172805a794 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.411669 Jun 15 14:58:49.187283 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 386/766] 10.222.0.42 () {60 vars in 1161 bytes} [Wed Jun 15 14:58:48 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:49.198590 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-42ecc4d5-486a-4b14-8fa5-aa46fee19563 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8acbca160>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:49.232786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-42ecc4d5-486a-4b14-8fa5-aa46fee19563 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.039298 Jun 15 14:58:49.233349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 387/767] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:49 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:49.245179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-74909d28-0f9e-4444-b0a7-7f5d8481da8f tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8accbd670>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:49.278813 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-74909d28-0f9e-4444-b0a7-7f5d8481da8f tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038095 Jun 15 14:58:49.279377 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 388/768] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Jun 15 14:58:49 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:49.290950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b01f8505-fe1f-4fd6-858e-bf99ad039bdb tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a856b9d0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:49.298070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:49.306417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-65df8e34-3888-4a9d-8cbe-080b90f3c1af tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.224154 Jun 15 14:58:49.307052 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 381/769] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:49 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:49.336543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b01f8505-fe1f-4fd6-858e-bf99ad039bdb tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.040269 Jun 15 14:58:49.336543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 389/770] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:49 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:50.081721 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-23fef88d-9adb-418c-9fc3-e6c7955c6e08 req-3a08652f-e699-4512-abab-72d2507dfd9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44bf928-fd4e-4132-93a4-286add941a90", "tag": "2cb63a99-4c69-4acc-8e82-ac92585111c9"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:50.091356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-23fef88d-9adb-418c-9fc3-e6c7955c6e08 req-3a08652f-e699-4512-abab-72d2507dfd9a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.091898 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-23fef88d-9adb-418c-9fc3-e6c7955c6e08 req-3a08652f-e699-4512-abab-72d2507dfd9a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.109148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-23fef88d-9adb-418c-9fc3-e6c7955c6e08 req-3a08652f-e699-4512-abab-72d2507dfd9a service nova] Creating event network-changed:2cb63a99-4c69-4acc-8e82-ac92585111c9 for instance f44bf928-fd4e-4132-93a4-286add941a90 on hv-cinder-78729 Jun 15 14:58:50.115117 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-23fef88d-9adb-418c-9fc3-e6c7955c6e08 req-3a08652f-e699-4512-abab-72d2507dfd9a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038072 Jun 15 14:58:50.115760 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 382/771] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:50.325217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:50.325796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:50.335869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.336789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.338186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.338950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.350960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6c0b3130-3b1f-4b5f-bc24-4bf0fec09153 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8340280>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:50.385143 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6c0b3130-3b1f-4b5f-bc24-4bf0fec09153 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.042029 Jun 15 14:58:50.385741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 383/772] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:50 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:50.497697 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:50.505960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d515ebd6-d502-452a-9a0d-0bbb0293dc84 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.185327 Jun 15 14:58:50.506533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 390/773] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:50 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:51.397401 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e7850024-231c-4155-b5a7-00a5d97c68aa tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8d78550>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:51.427271 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e7850024-231c-4155-b5a7-00a5d97c68aa tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.034196 Jun 15 14:58:51.427829 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 384/774] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:51 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:51.522904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:51.523514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:51.525820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:51.532058 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.532807 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.534645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.535418 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.674306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:51.682486 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-79594130-6d92-4f6c-aa8f-9ca6c774d3ca tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.163454 Jun 15 14:58:51.683047 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 391/775] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:51 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:52.439557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a5ba1c0c-1526-41b9-aa9c-4fce0eaed6e7 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a84e6af0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:52.471401 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a5ba1c0c-1526-41b9-aa9c-4fce0eaed6e7 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.036341 Jun 15 14:58:52.471981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 385/776] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:52 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:52.698619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:52.699174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:52.705716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:52.706224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:52.707188 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:52.707626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:52.838708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:52.846057 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-274a31c1-dc5f-49f2-bb42-38c8d6788b8b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.151391 Jun 15 14:58:52.846608 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 392/777] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:52 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:53.483349 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bb0d1f5c-46bf-4a20-93c8-587cfd526cf8 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a84da820>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:53.514603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bb0d1f5c-46bf-4a20-93c8-587cfd526cf8 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.035644 Jun 15 14:58:53.515216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 386/778] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:53 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:53.863335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:53.863940 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.870490 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.870930 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.871686 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.872142 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:54.008873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:54.016242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-de885364-5610-4b47-b31a-b66f461a0a9c tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.157267 Jun 15 14:58:54.016807 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 393/779] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:53 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:54.527900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f24b3cbf-a41e-44d8-8aa6-f8ef0118c92a tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8351dc0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:54.566844 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f24b3cbf-a41e-44d8-8aa6-f8ef0118c92a tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.041528 Jun 15 14:58:54.566844 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 387/780] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:54 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:55.033662 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:55.034908 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:55.041720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:55.042162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:55.043097 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:55.043361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:55.251196 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:55.259237 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f9f48f6-8c11-4cca-9df0-c67b1b98892e tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.229393 Jun 15 14:58:55.259841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 394/781] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:55 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:55.578466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cf600923-2ce5-4043-821d-caa6f06f7128 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8367f70>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:55.610038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cf600923-2ce5-4043-821d-caa6f06f7128 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 287 microversion: 2.1 time: 0.035735 Jun 15 14:58:55.610609 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 388/782] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:55 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:55.622116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8d74d38c-f017-4b0b-b148-db729caa26c4 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8acb97ee0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:55.736391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8d74d38c-f017-4b0b-b148-db729caa26c4 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 202 len: 0 microversion: 2.1 time: 0.117879 Jun 15 14:58:55.737728 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 395/783] 10.222.0.42 () {58 vars in 1253 bytes} [Wed Jun 15 14:58:55 2022] DELETE /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:55.743731 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:55.747758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-97c68f51-b203-408c-8f05-10dd56ac813b tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8351f70>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:55.778068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-97c68f51-b203-408c-8f05-10dd56ac813b tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 200 len: 286 microversion: 2.1 time: 0.035049 Jun 15 14:58:55.778635 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 389/784] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:55 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:56.277525 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:56.278149 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:56.284910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:56.285361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:56.286123 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:56.286555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:56.422911 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:56.431208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9e3dbcdb-90be-464b-828b-29d061bcf004 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.157715 Jun 15 14:58:56.431796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 396/785] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:56 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:56.786801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=12 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:56.791649 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4903e8d3-5eac-4174-9391-44aa6dadf6b5 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a84daf70>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:56.821385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-4903e8d3-5eac-4174-9391-44aa6dadf6b5 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] HTTP exception thrown: Snapshot c6345189-2299-4395-94e4-a3df68753774 could not be found. Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4903e8d3-5eac-4174-9391-44aa6dadf6b5 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Request method failure captured: Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 HTTP/1.1 Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfOlLAo4m5a2S0C4wSV9R8ahK5LY71Pi2BcNQ42Qbwc-sm55UjMM5uOQdPPGPiQlUc8_N8N7VusbiyvwBTExPVLtLf2PQZ-UGZ08alhlXso0cv_YvebG29Mkrjc1Af2EPD-M00LHwXTKV_ntwW0-EjoUvGRnuER3qpl7ORFoLGWS5Ac Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:58:56.824725 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: cbae2a0ce784498fb526fc0b21d00cf5 Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Snapshot c6345189-2299-4395-94e4-a3df68753774 could not be found. Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'c6345189-2299-4395-94e4-a3df68753774'} Jun 15 14:58:56.826284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c6345189-2299-4395-94e4-a3df68753774 could not be found. (HTTP 404) (Request-ID: req-551e43d9-fe6a-4740-a89c-a161179feceb) Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:56.827677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:58:56.829795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c6345189-2299-4395-94e4-a3df68753774 could not be found. Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 14:58:56.832684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c6345189-2299-4395-94e4-a3df68753774 could not be found. Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c6345189-2299-4395-94e4-a3df68753774 could not be found. Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4903e8d3-5eac-4174-9391-44aa6dadf6b5 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Returning 404 to user: Snapshot c6345189-2299-4395-94e4-a3df68753774 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:56.834141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4903e8d3-5eac-4174-9391-44aa6dadf6b5 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774" status: 404 len: 111 microversion: 2.1 time: 0.040099 Jun 15 14:58:56.835119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 390/786] 10.222.0.42 () {58 vars in 1250 bytes} [Wed Jun 15 14:58:56 2022] GET /compute/v2.1/os-snapshots/c6345189-2299-4395-94e4-a3df68753774 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:56.841952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b0a9dcfa-44e3-43d3-ae81-c38e1de338ac tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8accb8700>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:57.050775 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b0a9dcfa-44e3-43d3-ae81-c38e1de338ac tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 202 len: 0 microversion: 2.1 time: 0.214287 Jun 15 14:58:57.051416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 397/787] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 14:58:56 2022] DELETE /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:57.062659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e3a32db9-8d04-4d96-95ee-1d17e1b1d133 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8d78940>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:57.119520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e3a32db9-8d04-4d96-95ee-1d17e1b1d133 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 200 len: 344 microversion: 2.1 time: 0.063587 Jun 15 14:58:57.120165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 391/788] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:58:57 2022] GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:57.448555 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:57.449243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:57.455500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.456801 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.457568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.458001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.498705 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1200325976"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:57.499647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:57.501842 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:57.508801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.509250 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.510029 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.510464 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.634766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:57.642688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c37aa6f6-477c-43c5-a55b-9e7575d97560 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.198103 Jun 15 14:58:57.644400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 398/789] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:57 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:57.684193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.network.security_group_api [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Removing security group 732600f0-725c-4ccf-9bef-a68b6c56042a from port 08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 Jun 15 14:58:58.119269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e5f50936-8c62-4eab-a5c7-429ac0d1f289 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.624455 Jun 15 14:58:58.123152 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 392/790] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Jun 15 14:58:57 2022] POST /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:58:58.134085 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c848205e-c4d3-4864-8f43-692484a93d1c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8acb8ce50>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:58.135651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-64ec6189-dd39-4a52-aed6-2eff9ea8c6e0 req-7f143506-0834-4a6c-b84c-6d2cfa83bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a494d343-260a-4550-8b58-0c0007a1c0e9", "tag": "08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:58.165069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-64ec6189-dd39-4a52-aed6-2eff9ea8c6e0 req-7f143506-0834-4a6c-b84c-6d2cfa83bef0 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:58.165779 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-64ec6189-dd39-4a52-aed6-2eff9ea8c6e0 req-7f143506-0834-4a6c-b84c-6d2cfa83bef0 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:58.181256 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-64ec6189-dd39-4a52-aed6-2eff9ea8c6e0 req-7f143506-0834-4a6c-b84c-6d2cfa83bef0 service nova] Creating event network-changed:08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 for instance a494d343-260a-4550-8b58-0c0007a1c0e9 on hv-cinder-78729 Jun 15 14:58:58.187848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-64ec6189-dd39-4a52-aed6-2eff9ea8c6e0 req-7f143506-0834-4a6c-b84c-6d2cfa83bef0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056575 Jun 15 14:58:58.193813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 393/791] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:58.194351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-c848205e-c4d3-4864-8f43-692484a93d1c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] HTTP exception thrown: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c848205e-c4d3-4864-8f43-692484a93d1c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Request method failure captured: Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb HTTP/1.1 Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfOlLAo4m5a2S0C4wSV9R8ahK5LY71Pi2BcNQ42Qbwc-sm55UjMM5uOQdPPGPiQlUc8_N8N7VusbiyvwBTExPVLtLf2PQZ-UGZ08alhlXso0cv_YvebG29Mkrjc1Af2EPD-M00LHwXTKV_ntwW0-EjoUvGRnuER3qpl7ORFoLGWS5Ac Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:58:58.200403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: cbae2a0ce784498fb526fc0b21d00cf5 Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'bbe12488-d849-4248-856b-f44ab8cf2ceb'} Jun 15 14:58:58.202820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. (HTTP 404) (Request-ID: req-5e444a63-df46-4963-ac0c-261cbed8e432) Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.203607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:58:58.205194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:58:58.207116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c848205e-c4d3-4864-8f43-692484a93d1c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Returning 404 to user: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:58.209209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c848205e-c4d3-4864-8f43-692484a93d1c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 404 len: 109 microversion: 2.1 time: 0.072936 Jun 15 14:58:58.212163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 399/792] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:58:58 2022] GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:58.216519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6e1ada84-0b9f-43f9-a679-724d6d999b3c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8a8351550>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:58.270363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-6e1ada84-0b9f-43f9-a679-724d6d999b3c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] HTTP exception thrown: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6e1ada84-0b9f-43f9-a679-724d6d999b3c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Request method failure captured: Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: DELETE /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb HTTP/1.1 Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfOlLAo4m5a2S0C4wSV9R8ahK5LY71Pi2BcNQ42Qbwc-sm55UjMM5uOQdPPGPiQlUc8_N8N7VusbiyvwBTExPVLtLf2PQZ-UGZ08alhlXso0cv_YvebG29Mkrjc1Af2EPD-M00LHwXTKV_ntwW0-EjoUvGRnuER3qpl7ORFoLGWS5Ac Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:58:58.270994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: cbae2a0ce784498fb526fc0b21d00cf5 Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'bbe12488-d849-4248-856b-f44ab8cf2ceb'} Jun 15 14:58:58.272674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. (HTTP 404) (Request-ID: req-2cdeec09-06a7-4f13-9419-c4571eb19729) Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.273617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:58:58.275098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:58:58.276507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6e1ada84-0b9f-43f9-a679-724d6d999b3c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Returning 404 to user: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6e1ada84-0b9f-43f9-a679-724d6d999b3c tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 404 len: 109 microversion: 2.1 time: 0.060289 Jun 15 14:58:58.277903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 394/793] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 14:58:58 2022] DELETE /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:58.284274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6c3a71a3-8fe4-4321-b3d5-20376d67f7b9 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Calling method '.version_select at 0x7fb8acbca5e0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:58.326241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-6c3a71a3-8fe4-4321-b3d5-20376d67f7b9 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] HTTP exception thrown: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6c3a71a3-8fe4-4321-b3d5-20376d67f7b9 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Request method failure captured: Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb HTTP/1.1 Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfOlLAo4m5a2S0C4wSV9R8ahK5LY71Pi2BcNQ42Qbwc-sm55UjMM5uOQdPPGPiQlUc8_N8N7VusbiyvwBTExPVLtLf2PQZ-UGZ08alhlXso0cv_YvebG29Mkrjc1Af2EPD-M00LHwXTKV_ntwW0-EjoUvGRnuER3qpl7ORFoLGWS5Ac Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:58:58.328334 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_053765c8fc8342c6b155fdd11264fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 053765c8fc8342c6b155fdd11264fc24 Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2144724648 Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: cbae2a0ce784498fb526fc0b21d00cf5 Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2144724648-project Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'bbe12488-d849-4248-856b-f44ab8cf2ceb'} Jun 15 14:58:58.329928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. (HTTP 404) (Request-ID: req-fcf2cb79-703e-4d97-b958-656fc7e33efa) Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.330998 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:58:58.332496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:58:58.333875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6c3a71a3-8fe4-4321-b3d5-20376d67f7b9 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] Returning 404 to user: Volume bbe12488-d849-4248-856b-f44ab8cf2ceb could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6c3a71a3-8fe4-4321-b3d5-20376d67f7b9 tempest-VolumesSnapshotsTestJSON-2144724648 tempest-VolumesSnapshotsTestJSON-2144724648-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb" status: 404 len: 109 microversion: 2.1 time: 0.051960 Jun 15 14:58:58.335257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 400/794] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:58:58 2022] GET /compute/v2.1/os-volumes/bbe12488-d849-4248-856b-f44ab8cf2ceb => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:58.665070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:58.666146 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:58.675140 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:58.676107 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:58.677174 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:58.677856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:58.912619 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:58.925311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6a6eb461-70f4-4ded-a524-f02069ceeae6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.266850 Jun 15 14:58:58.927181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 395/795] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:58 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:59.658318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:59.659461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:59.667749 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.668261 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:59.675048 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.676773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:59.774069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lazy-loading 'services' on Instance uuid a494d343-260a-4550-8b58-0c0007a1c0e9 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:59.949495 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:59.950069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:59.962016 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.965939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:59.969034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.969512 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:00.014708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-50ea2da6-9a14-41ad-8430-b26bb8253830 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments/4e83d157-8671-4302-bfac-a72bab50359e" status: 202 len: 0 microversion: 2.1 time: 0.360575 Jun 15 14:59:00.015336 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 401/796] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 14:58:59 2022] DELETE /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments/4e83d157-8671-4302-bfac-a72bab50359e => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:59:00.043984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6049316a-2981-43b8-b9bd-419cd9c4fec5 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:00.046816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6049316a-2981-43b8-b9bd-419cd9c4fec5 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:00.057282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6049316a-2981-43b8-b9bd-419cd9c4fec5 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:00.057772 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6049316a-2981-43b8-b9bd-419cd9c4fec5 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:00.058559 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6049316a-2981-43b8-b9bd-419cd9c4fec5 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:00.059000 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6049316a-2981-43b8-b9bd-419cd9c4fec5 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:00.098068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6049316a-2981-43b8-b9bd-419cd9c4fec5 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077583 Jun 15 14:59:00.106760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 402/797] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:59:00 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:00.228567 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-791324ce-b34f-45e7-b981-31e279f6f2c8 req-8984ec94-89fa-4314-8dba-ca4edf9c9ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a494d343-260a-4550-8b58-0c0007a1c0e9", "tag": "08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:00.240297 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-791324ce-b34f-45e7-b981-31e279f6f2c8 req-8984ec94-89fa-4314-8dba-ca4edf9c9ccb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:00.240747 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-791324ce-b34f-45e7-b981-31e279f6f2c8 req-8984ec94-89fa-4314-8dba-ca4edf9c9ccb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:00.258637 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-791324ce-b34f-45e7-b981-31e279f6f2c8 req-8984ec94-89fa-4314-8dba-ca4edf9c9ccb service nova] Creating event network-changed:08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 for instance a494d343-260a-4550-8b58-0c0007a1c0e9 on hv-cinder-78729 Jun 15 14:59:00.264130 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-791324ce-b34f-45e7-b981-31e279f6f2c8 req-8984ec94-89fa-4314-8dba-ca4edf9c9ccb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041466 Jun 15 14:59:00.265364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 403/798] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:00.269048 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:00.278791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4aaadbab-eee5-49c4-aca4-a8d96bb7eb11 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.338884 Jun 15 14:59:00.288137 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 396/799] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:59 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:00.811759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ec26a09b-2879-4c20-b710-3fde29500544 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Action: 'create', calling method: .version_select at 0x7fb8acb8c280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1737496994", "metadata": {"Type": "work"}}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:01.119513 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e76d951-12d4-43e9-be90-0bebaad116ca tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:01.120770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0e76d951-12d4-43e9-be90-0bebaad116ca tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:01.128659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e76d951-12d4-43e9-be90-0bebaad116ca tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:01.129190 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e76d951-12d4-43e9-be90-0bebaad116ca tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.129975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e76d951-12d4-43e9-be90-0bebaad116ca tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:01.130428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e76d951-12d4-43e9-be90-0bebaad116ca tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.163297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0e76d951-12d4-43e9-be90-0bebaad116ca tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047962 Jun 15 14:59:01.164169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 397/800] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:59:01 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:01.301031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:01.301672 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:01.307948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:01.308445 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.310676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:01.310676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.509818 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ec26a09b-2879-4c20-b710-3fde29500544 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.832733 Jun 15 14:59:01.510459 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 404/801] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jun 15 14:59:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 835 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 14:59:01.515194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-2aa6b4f4-cefc-4bf5-9118-af9b197ef0e5 req-06eb5f11-ca61-47f8-a68d-4093fc2819b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44bf928-fd4e-4132-93a4-286add941a90", "name": "network-vif-plugged", "status": "completed", "tag": "2cb63a99-4c69-4acc-8e82-ac92585111c9"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:01.531283 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:01.531519 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2aa6b4f4-cefc-4bf5-9118-af9b197ef0e5 req-06eb5f11-ca61-47f8-a68d-4093fc2819b0 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:01.531963 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2aa6b4f4-cefc-4bf5-9118-af9b197ef0e5 req-06eb5f11-ca61-47f8-a68d-4093fc2819b0 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.544469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-2aa6b4f4-cefc-4bf5-9118-af9b197ef0e5 req-06eb5f11-ca61-47f8-a68d-4093fc2819b0 service nova] Creating event network-vif-plugged:2cb63a99-4c69-4acc-8e82-ac92585111c9 for instance f44bf928-fd4e-4132-93a4-286add941a90 on hv-cinder-78729 Jun 15 14:59:01.550062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-2aa6b4f4-cefc-4bf5-9118-af9b197ef0e5 req-06eb5f11-ca61-47f8-a68d-4093fc2819b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038425 Jun 15 14:59:01.551091 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 405/802] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:01.558568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0a037961-1588-46b3-afd1-5c9fc5fea0be tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Calling method '.version_select at 0x7fb8acc03310>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:01.559241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3a66255c-178f-468b-8f07-af94cadc9569 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.263003 Jun 15 14:59:01.560557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 398/803] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:01 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:01.617498 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0a037961-1588-46b3-afd1-5c9fc5fea0be tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc" status: 200 len: 353 microversion: 2.1 time: 0.065186 Jun 15 14:59:01.618069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 406/804] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:59:01 2022] GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:02.175676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8bb8b284-2ad3-41b7-8b59-b2033a57b5a3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:02.176870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8bb8b284-2ad3-41b7-8b59-b2033a57b5a3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:02.183333 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8bb8b284-2ad3-41b7-8b59-b2033a57b5a3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.183781 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8bb8b284-2ad3-41b7-8b59-b2033a57b5a3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.184571 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8bb8b284-2ad3-41b7-8b59-b2033a57b5a3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.185002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8bb8b284-2ad3-41b7-8b59-b2033a57b5a3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.213787 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8bb8b284-2ad3-41b7-8b59-b2033a57b5a3 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042760 Jun 15 14:59:02.214349 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 399/805] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 14:59:02 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:59:02.225323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:02.225938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:02.232269 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.232718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.234029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.234029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.255746 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:02.317843 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] HTTP exception thrown: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 is not attached to volume 4e83d157-8671-4302-bfac-a72bab50359e Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Request method failure captured: Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments/4e83d157-8671-4302-bfac-a72bab50359e HTTP/1.1 Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfKh5dQEqjuzI5WMti006RdO97KY8ULD6RhqX5YjphTRCbGqjQswxJKczWtPwKU7MEbvLTU1rfS_Ch5ahQ1RXGGxbIle9UgIq_Gn3lo1tNpasJdr-2r1QKQK--moZhQS_v6J5BFX_LjlKvKsQMnau171eSkB8nwqwQMGG3NCJ4mlGdk Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 7a96a40d9feb40b8bbc143f1f9be7408 Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-TestMinimumBasicScenario-64188443 Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 14:59:02.322406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-TestMinimumBasicScenario-64188443 Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 7a96a40d9feb40b8bbc143f1f9be7408 Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-64188443 Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-TestMinimumBasicScenario-64188443-project Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 8a8c023cd5014daa993be2735b1c05ab Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-TestMinimumBasicScenario-64188443-project Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 14:59:02.324011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 is not attached to volume 4e83d157-8671-4302-bfac-a72bab50359e Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'server_id': 'a494d343-260a-4550-8b58-0c0007a1c0e9', 'id': '4e83d157-8671-4302-bfac-a72bab50359e'} Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4e83d157-8671-4302-bfac-a72bab50359e. Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:59:02.324924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 is not attached to volume 4e83d157-8671-4302-bfac-a72bab50359e Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 is not attached to volume 4e83d157-8671-4302-bfac-a72bab50359e Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 14:59:02.326341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Returning 404 to user: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 is not attached to volume 4e83d157-8671-4302-bfac-a72bab50359e {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:59:02.327638 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-05e1637e-8e25-4b98-8010-ac751df65e20 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments/4e83d157-8671-4302-bfac-a72bab50359e" status: 404 len: 154 microversion: 2.1 time: 0.104226 Jun 15 14:59:02.327638 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 407/806] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 14:59:02 2022] DELETE /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9/os-volume_attachments/4e83d157-8671-4302-bfac-a72bab50359e => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:59:02.577699 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:02.578221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:02.585009 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.585456 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.586266 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.592059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.632529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-eb2053aa-ab68-4621-8c46-27b737e41914 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Calling method '.version_select at 0x7fb8a8676700>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:02.685924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-eb2053aa-ab68-4621-8c46-27b737e41914 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc" status: 200 len: 353 microversion: 2.1 time: 0.056048 Jun 15 14:59:02.685924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 408/807] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:59:02 2022] GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:02.724959 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:02.728489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:02.732887 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-325df01c-6b4b-4f1b-85c0-9168507398e3 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.159346 Jun 15 14:59:02.733453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 400/808] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:02 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:03.585668 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:03.590630 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:03.593852 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.594303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.595327 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.595812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.622358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:59:03.696395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-aa7d73da-c976-4067-bd68-d6d76dad9040 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Calling method '.version_select at 0x7fb8a8f273a0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:03.746654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-aa7d73da-c976-4067-bd68-d6d76dad9040 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc" status: 200 len: 354 microversion: 2.1 time: 0.054026 Jun 15 14:59:03.747221 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 401/809] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:59:03 2022] GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:03.758294 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:03.758915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:03.769336 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.769805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.770577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.771018 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.912029 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:03.919677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4eb68baa-de18-427f-864d-87accaeb1586 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.165257 Jun 15 14:59:03.920473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 402/810] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:03 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:03.929120 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-da9e847a-7a2a-4752-ba61-4366b743d959 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Calling method '.version_select at 0x7fb8a83b1820>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:03.935900 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ffdc305f-6a7b-4ace-9c20-1e30674384d7 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 204 len: 0 microversion: 2.1 time: 0.355153 Jun 15 14:59:03.936651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 409/811] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 14:59:03 2022] DELETE /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:59:03.946331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:03.947125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:03.953588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.958234 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.958234 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.958234 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.984709 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-da9e847a-7a2a-4752-ba61-4366b743d959 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc" status: 200 len: 354 microversion: 2.1 time: 0.062848 Jun 15 14:59:03.985354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 403/812] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:59:03 2022] GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:04.004073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d4987ac7-8672-419f-8a61-16413b3b7efd tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Calling method '.version_select at 0x7fb8a8d4f5e0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:04.094087 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:04.102503 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-62b4e675-8ea4-45bc-9419-f140ed49c1d4 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1554 microversion: 2.1 time: 0.160387 Jun 15 14:59:04.103064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 410/813] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:03 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:04.260434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d4987ac7-8672-419f-8a61-16413b3b7efd tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc" status: 202 len: 0 microversion: 2.1 time: 0.261117 Jun 15 14:59:04.261229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 404/814] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 14:59:03 2022] DELETE /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:59:04.273299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5184172a-013b-4b06-ac69-c01837aeee00 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Calling method '.version_select at 0x7fb8acc3f040>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:04.322723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5184172a-013b-4b06-ac69-c01837aeee00 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc" status: 200 len: 353 microversion: 2.1 time: 0.053423 Jun 15 14:59:04.323299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 411/815] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:59:04 2022] GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:04.946399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:04.947142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:04.954213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:04.954665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:04.959073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:04.959073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:05.091323 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:05.099362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c452b86e-9ad1-46e6-be60-980e5e81827d tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.158196 Jun 15 14:59:05.099920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 405/816] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:04 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:05.119677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:05.120785 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:05.126918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:05.127847 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:05.128888 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:05.129330 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:05.264032 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:05.272853 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-dc88125b-99a4-4936-bf35-5e30b309637d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1554 microversion: 2.1 time: 0.157502 Jun 15 14:59:05.273421 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 412/817] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:05 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:05.335694 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e40adf9c-a803-49f9-82b9-b04a05ca7967 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Calling method '.version_select at 0x7fb8a83b1670>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:05.364340 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-e40adf9c-a803-49f9-82b9-b04a05ca7967 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] HTTP exception thrown: Volume cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc could not be found. Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e40adf9c-a803-49f9-82b9-b04a05ca7967 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Request method failure captured: Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc HTTP/1.1 Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfO0MIPtDLL4yDF79CRU_1bgnsGlWmCtaW40Ddlu2JZmj_CiqCR5Ki6MMEPjB9KoDhrmHL_Am863khnLcFP5iDNVLQ4hL5d-ykJ7It2gxC5ma-Ghfpv4wZ6qWBEucPRLDEjKy9RYg7rvzgmJC1iIWWZfMM_DbtfOxS6eNXADIuCkOyk Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: df4d0ffecc7f40b4a34f51c714d96fa5 Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesGetTestJSON-2012819725 Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:59:05.365996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df4d0ffecc7f40b4a34f51c714d96fa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df4d0ffecc7f40b4a34f51c714d96fa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df4d0ffecc7f40b4a34f51c714d96fa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df4d0ffecc7f40b4a34f51c714d96fa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesGetTestJSON-2012819725 Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: df4d0ffecc7f40b4a34f51c714d96fa5 Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesGetTestJSON-2012819725 Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesGetTestJSON-2012819725-project Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: c1e9c64746444cd3ba00d33d5898a8e0 Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesGetTestJSON-2012819725-project Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Volume cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc could not be found. Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc'} Jun 15 14:59:05.367644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc could not be found. (HTTP 404) (Request-ID: req-6662651a-f280-45a4-b5b8-7d28c9b211d6) Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:05.368632 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:59:05.369974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc could not be found. Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:59:05.371628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc could not be found. Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc could not be found. Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e40adf9c-a803-49f9-82b9-b04a05ca7967 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] Returning 404 to user: Volume cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e40adf9c-a803-49f9-82b9-b04a05ca7967 tempest-VolumesGetTestJSON-2012819725 tempest-VolumesGetTestJSON-2012819725-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc" status: 404 len: 109 microversion: 2.1 time: 0.035997 Jun 15 14:59:05.373083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 406/818] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 14:59:05 2022] GET /compute/v2.1/os-volumes/cd76a2e6-e5c0-4a6e-b8c6-35e2cc2761bc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:59:06.117147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:06.117958 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:06.124296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:06.124938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:06.125512 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:06.125952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:06.290694 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:06.291495 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:06.298210 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:06.298663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:06.299973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:06.300437 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:06.343775 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:06.351739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b05a6ba6-cb80-4bd2-ae2a-af7bebe646b4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1363 microversion: 2.1 time: 0.238604 Jun 15 14:59:06.360920 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 413/819] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:06 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:06.466735 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:06.475142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ed601042-bc88-44e4-aa79-486b099f496d tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1554 microversion: 2.1 time: 0.188856 Jun 15 14:59:06.475712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 407/820] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:06 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:07.368584 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:07.375917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:07.376214 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:07.376514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:07.378363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:07.379076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:07.493227 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:07.493902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:07.500917 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:07.501368 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:07.502535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:07.502978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:07.515400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:07.537480 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-623cdd4d-49a8-4bf9-9e24-37a843dc4fb6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1550 microversion: 2.1 time: 0.172670 Jun 15 14:59:07.542415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 414/821] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:07 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:07.561964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0036d740-eed0-45ad-abbd-70f795d2e8c0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:07.562540 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0036d740-eed0-45ad-abbd-70f795d2e8c0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:07.571527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0036d740-eed0-45ad-abbd-70f795d2e8c0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:07.577115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0036d740-eed0-45ad-abbd-70f795d2e8c0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:07.577115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0036d740-eed0-45ad-abbd-70f795d2e8c0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:07.577115 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0036d740-eed0-45ad-abbd-70f795d2e8c0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:07.708439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0036d740-eed0-45ad-abbd-70f795d2e8c0 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155122 Jun 15 14:59:07.709271 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 415/822] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 14:59:07 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:07.716138 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:07.725488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3990bdcf-4f41-444a-ab3e-f1500fa0a189 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1554 microversion: 2.1 time: 0.236207 Jun 15 14:59:07.732489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 408/823] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:07 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:08.744808 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:08.745310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:08.753386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:08.753836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:08.755261 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:08.755921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:09.059542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:09.068878 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-361a75f4-5703-46c8-9dff-95b70740bfc8 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1554 microversion: 2.1 time: 0.328525 Jun 15 14:59:09.070957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 416/824] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:08 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1554 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:09.257386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-aa868630-8f32-4c92-b108-7cbfcdafe566 req-470cc254-0cbb-4cff-a66a-924a523e3db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a494d343-260a-4550-8b58-0c0007a1c0e9", "name": "network-vif-deleted", "tag": "08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:09.272699 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-aa868630-8f32-4c92-b108-7cbfcdafe566 req-470cc254-0cbb-4cff-a66a-924a523e3db5 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:09.273075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-aa868630-8f32-4c92-b108-7cbfcdafe566 req-470cc254-0cbb-4cff-a66a-924a523e3db5 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:09.287659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-aa868630-8f32-4c92-b108-7cbfcdafe566 req-470cc254-0cbb-4cff-a66a-924a523e3db5 service nova] Creating event network-vif-deleted:08fed4d4-bcf6-4ec9-bcfd-d8dd09fe5f61 for instance a494d343-260a-4550-8b58-0c0007a1c0e9 on hv-cinder-78729 Jun 15 14:59:09.295800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-aa868630-8f32-4c92-b108-7cbfcdafe566 req-470cc254-0cbb-4cff-a66a-924a523e3db5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041552 Jun 15 14:59:09.296825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 409/825] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:10.087922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:10.095948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:10.095948 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:10.096343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:10.096863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:10.097488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:10.131180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:10.131629 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:10.132098 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lazy-loading 'fault' on Instance uuid a494d343-260a-4550-8b58-0c0007a1c0e9 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:59:10.175822 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8c023cd5014daa993be2735b1c05ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a96a40d9feb40b8bbc143f1f9be7408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:10.184425 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-13a16886-a1ca-4d0b-b18a-f7c11f9cee95 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 200 len: 1348 microversion: 2.1 time: 0.102055 Jun 15 14:59:10.185141 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 417/826] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:10 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:11.202772 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:11.206016 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] [instance: a494d343-260a-4550-8b58-0c0007a1c0e9] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:11.211047 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:11.211526 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:11.212338 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:11.212775 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:11.226538 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] HTTP exception thrown: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 could not be found. Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Request method failure captured: Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 HTTP/1.1 Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfKh5dQEqjuzI5WMti006RdO97KY8ULD6RhqX5YjphTRCbGqjQswxJKczWtPwKU7MEbvLTU1rfS_Ch5ahQ1RXGGxbIle9UgIq_Gn3lo1tNpasJdr-2r1QKQK--moZhQS_v6J5BFX_LjlKvKsQMnau171eSkB8nwqwQMGG3NCJ4mlGdk Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 7a96a40d9feb40b8bbc143f1f9be7408 Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-TestMinimumBasicScenario-64188443 Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 14:59:11.228235 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7a96a40d9feb40b8bbc143f1f9be7408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-TestMinimumBasicScenario-64188443 Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 7a96a40d9feb40b8bbc143f1f9be7408 Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-TestMinimumBasicScenario-64188443 Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-TestMinimumBasicScenario-64188443-project Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 8a8c023cd5014daa993be2735b1c05ab Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-TestMinimumBasicScenario-64188443-project Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 could not be found. Jun 15 14:59:11.229860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'a494d343-260a-4550-8b58-0c0007a1c0e9'} Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 could not be found. Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:59:11.230808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 could not be found. Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 could not be found. Jun 15 14:59:11.237945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 14:59:11.239337 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Returning 404 to user: Instance a494d343-260a-4550-8b58-0c0007a1c0e9 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:59:11.239337 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-09d7b5d5-5f59-4de5-bbae-a74136b42e49 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9" status: 404 len: 111 microversion: 2.1 time: 0.031700 Jun 15 14:59:11.239337 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 410/827] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:11 2022] GET /compute/v2.1/servers/a494d343-260a-4550-8b58-0c0007a1c0e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:59:11.241032 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2f9855b9-717a-4d33-8d13-a5b7496fee85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] Calling method '.version_select at 0x7fb8acb18dc0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:11.320916 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2f9855b9-717a-4d33-8d13-a5b7496fee85 tempest-TestMinimumBasicScenario-64188443 tempest-TestMinimumBasicScenario-64188443-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1150452139" status: 202 len: 0 microversion: 2.1 time: 0.086279 Jun 15 14:59:11.325107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 418/828] 10.222.0.42 () {58 vars in 1271 bytes} [Wed Jun 15 14:59:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1150452139 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:59:11.344805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-8fb3ca20-10c6-4e72-8d49-168b3c9c193f req-a2d373db-4486-4c8c-b459-2ab2dff36ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44bf928-fd4e-4132-93a4-286add941a90", "tag": "2cb63a99-4c69-4acc-8e82-ac92585111c9"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:11.353557 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8fb3ca20-10c6-4e72-8d49-168b3c9c193f req-a2d373db-4486-4c8c-b459-2ab2dff36ceb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:11.354002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8fb3ca20-10c6-4e72-8d49-168b3c9c193f req-a2d373db-4486-4c8c-b459-2ab2dff36ceb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:11.368774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-8fb3ca20-10c6-4e72-8d49-168b3c9c193f req-a2d373db-4486-4c8c-b459-2ab2dff36ceb service nova] Creating event network-changed:2cb63a99-4c69-4acc-8e82-ac92585111c9 for instance f44bf928-fd4e-4132-93a4-286add941a90 on hv-cinder-78729 Jun 15 14:59:11.374954 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-8fb3ca20-10c6-4e72-8d49-168b3c9c193f req-a2d373db-4486-4c8c-b459-2ab2dff36ceb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 Jun 15 14:59:11.376623 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 411/829] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:53.579106 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:53.580686 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:53.583863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-62839727", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "networks": [{"uuid": "4dda5a59-20a0-4613-bf09-19d0b8d052cd"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:53.641592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] validate_networks() for [('4dda5a59-20a0-4613-bf09-19d0b8d052cd', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:59:53.994458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:59:53.994878 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:59:53.995354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:59:53.995762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:59:53.996190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:59:54.006451 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.006830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.007666 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.008148 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.027037 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Getting quotas for project c0a0e27741434fd282a638aefa713c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:59:54.031538 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Getting quotas for user 33f42c17c1374253b7716ffe0ffbaa6d and project c0a0e27741434fd282a638aefa713c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:59:54.042419 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:59:54.045422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:59:54.176619 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c6f46b5a-279c-4de9-a2af-b100a0640e05 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599070 Jun 15 14:59:54.177354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 419/830] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 14:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:59:54.189034 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-960e8b0e-29ff-486b-8673-d49058f85251 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:54.189745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-960e8b0e-29ff-486b-8673-d49058f85251 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:54.192196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=29 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:54.198158 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=30 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:54.252070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-960e8b0e-29ff-486b-8673-d49058f85251 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:54.259460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-960e8b0e-29ff-486b-8673-d49058f85251 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1212 microversion: 2.1 time: 0.075878 Jun 15 14:59:54.260041 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 412/831] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:54 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1212 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:55.276723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:55.277338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:55.283937 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.284539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:55.285311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.285749 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:55.349140 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:55.357186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0a73b5b3-4614-4e6a-87ff-1902036819e0 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1216 microversion: 2.1 time: 0.084200 Jun 15 14:59:55.357755 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 420/832] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:55 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:56.375195 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:56.376420 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:56.383726 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:56.384206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:56.384969 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:56.385403 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:56.450587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:56.458667 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bc045a5d-b44b-48fc-ac67-2985f9c72102 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1264 microversion: 2.1 time: 0.088751 Jun 15 14:59:56.459224 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 413/833] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:56 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:57.476522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:57.477171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:57.484422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:57.484878 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:57.485647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:57.486087 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:57.736454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:57.744168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4d458a82-bc54-4ed6-8e57-edb25be9d4e7 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.271596 Jun 15 14:59:57.744755 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 421/834] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:57 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:58.373372 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-cbbd995c-084a-4534-b50e-9c4656e48688 req-486dc52e-f262-4907-8333-da9bd17fab78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2ef8f3-ef42-4f94-9250-33683ca74547", "tag": "5c2fad44-2233-437f-893e-fedc62aa527e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:58.389981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-cbbd995c-084a-4534-b50e-9c4656e48688 req-486dc52e-f262-4907-8333-da9bd17fab78 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.390850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-cbbd995c-084a-4534-b50e-9c4656e48688 req-486dc52e-f262-4907-8333-da9bd17fab78 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.411287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-cbbd995c-084a-4534-b50e-9c4656e48688 req-486dc52e-f262-4907-8333-da9bd17fab78 service nova] Creating event network-changed:5c2fad44-2233-437f-893e-fedc62aa527e for instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 on hv-cinder-78729 Jun 15 14:59:58.417231 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-cbbd995c-084a-4534-b50e-9c4656e48688 req-486dc52e-f262-4907-8333-da9bd17fab78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051261 Jun 15 14:59:58.421490 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 414/835] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:58.762405 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:58.764019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:58.771016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.771436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.772282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.772718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.993265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:59.000837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9fb2c7bd-a0e4-4f3f-8d7c-aa9d516cd059 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.242188 Jun 15 14:59:59.001680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 422/836] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:58 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:00.019793 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:00.020519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:00.026723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.027168 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.027925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.028395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.157298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:00.164795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6347923c-f52f-4da3-bacf-90bcf7561285 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.150393 Jun 15 15:00:00.165364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 415/837] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:00 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:01.181769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:01.182350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:01.188908 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:01.189357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:01.190124 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:01.190564 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:01.320002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:01.327439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-26a9c6dc-1e4c-4689-9b4f-2bd5db3f341a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.149627 Jun 15 15:00:01.327999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 423/838] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:01 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:02.344635 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:02.345264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:02.351888 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.352383 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.353164 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.353612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.488707 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:02.495586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c7e1ed6b-955c-409e-80a9-4a528ed3c819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.155231 Jun 15 15:00:02.496172 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 416/839] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:02 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:03.513177 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:03.513863 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:03.522890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.522890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.522890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.522890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.675273 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:03.683290 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-72ab444a-05d1-475f-8b00-25d79dd9bd8b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.173905 Jun 15 15:00:03.684077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 424/840] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:03 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:04.699684 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:04.700408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:04.703492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:04.708730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.709228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.709981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.710415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.845601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:04.853626 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e9d1cc7e-6bb3-4579-8dd3-76864fcc8632 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.157822 Jun 15 15:00:04.858083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 417/841] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:04 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:05.849008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-2708b3d4-c164-4b8f-ad35-96ada10693e2 req-bfb16daf-32e0-4fb7-b960-56e518b0ab59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2ef8f3-ef42-4f94-9250-33683ca74547", "name": "network-vif-plugged", "status": "completed", "tag": "5c2fad44-2233-437f-893e-fedc62aa527e"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:05.852670 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:05.853690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:05.859747 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2708b3d4-c164-4b8f-ad35-96ada10693e2 req-bfb16daf-32e0-4fb7-b960-56e518b0ab59 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.860221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2708b3d4-c164-4b8f-ad35-96ada10693e2 req-bfb16daf-32e0-4fb7-b960-56e518b0ab59 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.870813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:05.871556 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:05.872843 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-2708b3d4-c164-4b8f-ad35-96ada10693e2 req-bfb16daf-32e0-4fb7-b960-56e518b0ab59 service nova] Creating event network-vif-plugged:5c2fad44-2233-437f-893e-fedc62aa527e for instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 on hv-cinder-78729 Jun 15 15:00:05.881238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-2708b3d4-c164-4b8f-ad35-96ada10693e2 req-bfb16daf-32e0-4fb7-b960-56e518b0ab59 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033676 Jun 15 15:00:05.881449 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.881449 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.881650 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 425/842] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:05.881741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.881741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.021806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:06.029414 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5c4f5e5c-0d5c-4e10-8739-9e2dc936c1ba tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.162543 Jun 15 15:00:06.029985 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 418/843] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:05 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:07.047953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:07.048670 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:07.055497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.055941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.056727 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.057157 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.193152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:07.201732 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-440b0db2-5181-455b-a282-763a29ecca7e tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.158616 Jun 15 15:00:07.202258 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 426/844] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:07 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:08.218696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:08.219253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:08.226106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.226559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.227334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.227773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.359124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:08.366535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fd7eb84e-6aa7-48be-acfc-bf7a8768735c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1312 microversion: 2.1 time: 0.152509 Jun 15 15:00:08.367098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 419/845] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:08 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:09.383305 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:09.383941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:09.391288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:09.391742 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:09.392546 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:09.392979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:09.528253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:09.535847 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-07d2d317-b494-4aa2-8337-53508483b819 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1497 microversion: 2.1 time: 0.156389 Jun 15 15:00:09.536454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 427/846] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:09 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:10.437118 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:10.437766 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:10.444203 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.444654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.445422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.445852 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.472032 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Going to try to terminate instance {{(pid=124660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:00:10.831962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4bc052f5-06c4-40aa-a3dd-83e7d5b10f87 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 204 len: 0 microversion: 2.1 time: 0.398802 Jun 15 15:00:10.832624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 420/847] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:00:10 2022] DELETE /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:00:10.841081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:10.841755 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:10.849001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.849445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.850212 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.850644 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.985994 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:10.993766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aa4533f1-bc8b-48fb-8607-0b7d02d77c72 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1503 microversion: 2.1 time: 0.156727 Jun 15 15:00:10.994352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 428/848] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:10 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:12.013087 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:12.013806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:12.021500 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.022996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.022996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.023197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.270794 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:12.278446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4d847228-8f0d-45bd-99a7-3c91667196cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1503 microversion: 2.1 time: 0.269735 Jun 15 15:00:12.279037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 421/849] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:12 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:13.294807 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:13.295428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:13.302227 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.302677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.303446 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.303887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.853396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:13.861733 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-96b4161f-039f-4a10-9eaf-9f35f449917d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1503 microversion: 2.1 time: 0.570814 Jun 15 15:00:13.862306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 429/850] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:13 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1503 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:13.885370 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-18f2e513-e3d3-47fb-be75-2c6882433721 req-00b4596b-b7e4-414d-b1ac-dd1c217b9c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2ef8f3-ef42-4f94-9250-33683ca74547", "name": "network-vif-deleted", "tag": "5c2fad44-2233-437f-893e-fedc62aa527e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:13.894896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-18f2e513-e3d3-47fb-be75-2c6882433721 req-00b4596b-b7e4-414d-b1ac-dd1c217b9c00 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.895330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-18f2e513-e3d3-47fb-be75-2c6882433721 req-00b4596b-b7e4-414d-b1ac-dd1c217b9c00 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.907603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-18f2e513-e3d3-47fb-be75-2c6882433721 req-00b4596b-b7e4-414d-b1ac-dd1c217b9c00 service nova] Creating event network-vif-deleted:5c2fad44-2233-437f-893e-fedc62aa527e for instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 on hv-cinder-78729 Jun 15 15:00:13.912505 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-18f2e513-e3d3-47fb-be75-2c6882433721 req-00b4596b-b7e4-414d-b1ac-dd1c217b9c00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Jun 15 15:00:13.914322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 422/851] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:14.880292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:14.880855 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:14.887645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.897352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.897352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.897352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.923143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.923588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.924049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lazy-loading 'fault' on Instance uuid 5d2ef8f3-ef42-4f94-9250-33683ca74547 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:14.969622 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:14.977602 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-11ae02ff-2be2-45ca-8685-1f0e21062533 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 200 len: 1302 microversion: 2.1 time: 0.101642 Jun 15 15:00:14.978193 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 430/852] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:14 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:15.997664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:15.998379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 5d2ef8f3-ef42-4f94-9250-33683ca74547] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:16.004951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.005405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.006179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.006687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.021476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] HTTP exception thrown: Instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 could not be found. Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Request method failure captured: Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 HTTP/1.1 Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfPmjQEUznNP53XA_gRvp6MzDb6Z_bxdB0ETuevmFHW9D8L-UqdFc5rmH5DYMnB_jE4tCR52dtvEn74ox3vc_5f90OOJJRRcf9IvqYxtuKkRw0GxMw0xjyQiFApuYx6B8ixnhrBmfzo3-ys4F8YiH6PtpxdNWV8Bk08V9ncm1cFE1f8 Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: c0a0e27741434fd282a638aefa713c91 Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesActionsTest-2109529788 Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:00:16.023216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0a0e27741434fd282a638aefa713c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0a0e27741434fd282a638aefa713c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0a0e27741434fd282a638aefa713c91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0a0e27741434fd282a638aefa713c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesActionsTest-2109529788 Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: c0a0e27741434fd282a638aefa713c91 Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesActionsTest-2109529788 Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesActionsTest-2109529788-project Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 33f42c17c1374253b7716ffe0ffbaa6d Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesActionsTest-2109529788-project Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 could not be found. Jun 15 15:00:16.024740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '5d2ef8f3-ef42-4f94-9250-33683ca74547'} Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 could not be found. Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:16.025586 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 could not be found. Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 could not be found. Jun 15 15:00:16.026893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:16.028149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Returning 404 to user: Instance 5d2ef8f3-ef42-4f94-9250-33683ca74547 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:16.028149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-96cdb131-2236-41f2-a4b3-0ed4ef4d2135 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547" status: 404 len: 111 microversion: 2.1 time: 0.033581 Jun 15 15:00:16.028149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 423/853] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:15 2022] GET /compute/v2.1/servers/5d2ef8f3-ef42-4f94-9250-33683ca74547 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:16.133517 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1536116200", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "networks": [{"uuid": "4dda5a59-20a0-4613-bf09-19d0b8d052cd"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:16.196485 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] validate_networks() for [('4dda5a59-20a0-4613-bf09-19d0b8d052cd', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:00:16.657398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:00:16.657398 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:00:16.657667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:00:16.657883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:00:16.658298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:00:16.667760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.668250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.669173 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.669617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.688607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Getting quotas for project c0a0e27741434fd282a638aefa713c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:00:16.693748 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Getting quotas for user 33f42c17c1374253b7716ffe0ffbaa6d and project c0a0e27741434fd282a638aefa713c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:00:16.705799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:00:16.711060 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:00:16.873299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-12929a93-2821-4325-a157-1557c994ada8 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743816 Jun 15 15:00:16.874487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 431/854] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:00:16.886199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8c0127db-3e42-41dc-9cec-c0d790ac4d00 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:16.886881 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8c0127db-3e42-41dc-9cec-c0d790ac4d00 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:16.948118 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8c0127db-3e42-41dc-9cec-c0d790ac4d00 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:16.956010 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8c0127db-3e42-41dc-9cec-c0d790ac4d00 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1214 microversion: 2.1 time: 0.073901 Jun 15 15:00:16.956617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 424/855] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:16 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:17.974382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f37e4174-9713-44db-924b-229c03558ffb tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:17.975083 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f37e4174-9713-44db-924b-229c03558ffb tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:18.027503 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f37e4174-9713-44db-924b-229c03558ffb tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:18.035245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f37e4174-9713-44db-924b-229c03558ffb tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1214 microversion: 2.1 time: 0.065281 Jun 15 15:00:18.035831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 432/856] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:17 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:19.052614 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:19.053217 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:19.060870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:19.061487 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:19.062327 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:19.062800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:19.126861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:19.135012 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f38fce96-21fb-4cd6-8bee-f3c60a29452b tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1210 microversion: 2.1 time: 0.086360 Jun 15 15:00:19.135605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 425/857] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:19 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:20.152999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:20.153626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:20.161835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.172344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.172344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.172344 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.240828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:20.248578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-67a4ff9a-7efb-4a0b-bde4-2f6c13615e3f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1274 microversion: 2.1 time: 0.099382 Jun 15 15:00:20.250075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 433/858] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:20 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:21.266214 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:21.272787 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:21.273718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.274243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.275027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.275467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.442399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:21.450956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ed8e4c42-b6b6-4e5d-90e0-324afae4c21c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.189182 Jun 15 15:00:21.451606 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 426/859] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:21 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:21.813326 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-33180224-8113-4051-87e8-2dec15506dd6 req-d4a4135a-091f-4bb4-86bc-590acefa16f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "444bf318-3448-4659-8480-c30aa659c5d6", "tag": "a7f35f1a-1734-4a24-83b5-3c172f5f5aec"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:21.826975 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-33180224-8113-4051-87e8-2dec15506dd6 req-d4a4135a-091f-4bb4-86bc-590acefa16f9 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.827428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-33180224-8113-4051-87e8-2dec15506dd6 req-d4a4135a-091f-4bb4-86bc-590acefa16f9 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.839219 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-33180224-8113-4051-87e8-2dec15506dd6 req-d4a4135a-091f-4bb4-86bc-590acefa16f9 service nova] Creating event network-changed:a7f35f1a-1734-4a24-83b5-3c172f5f5aec for instance 444bf318-3448-4659-8480-c30aa659c5d6 on hv-cinder-78729 Jun 15 15:00:21.845208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-33180224-8113-4051-87e8-2dec15506dd6 req-d4a4135a-091f-4bb4-86bc-590acefa16f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038763 Jun 15 15:00:21.847825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 434/860] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:22.469657 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:22.470288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:22.477262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.477723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.478540 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.478990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.699342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:22.707271 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2c07fd57-288b-4f4d-9cfd-664c3bc139c9 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.242014 Jun 15 15:00:22.708120 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 427/861] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:22 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:23.725806 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:23.726508 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:23.732873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.734153 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.735076 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.735523 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.867409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:23.869839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=81 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:23.876220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0327dae2-5c7d-491c-8005-841622705c6d tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.154804 Jun 15 15:00:23.876787 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 435/862] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:23 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:24.894253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:24.894793 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:24.897223 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:24.902030 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.902484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.903261 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.903697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.037005 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:25.044387 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-634081ad-0ba7-48c3-98f0-c1099e4ffc2a tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.154856 Jun 15 15:00:25.044955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 428/863] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:24 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:26.061468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:26.062123 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:26.064583 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:26.069684 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.070117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.070866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.071299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.205439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:26.212962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e7fabdc3-0b66-4d70-bd8f-0d2d3d5a81cf tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.155722 Jun 15 15:00:26.213526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 436/864] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:26 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:27.230389 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:27.231003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:27.233768 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:27.238624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.239078 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.239843 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.240332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.242878 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:27.370331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:27.379964 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-09cce91b-3f82-4ced-a658-314103afc836 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.153359 Jun 15 15:00:27.380899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 429/865] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:27 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:28.164952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-9526721d-ef16-44f0-b6f1-b65e3557911c req-788c7265-ac75-4ad3-af51-2a6de5b4fb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "444bf318-3448-4659-8480-c30aa659c5d6", "name": "network-vif-plugged", "status": "completed", "tag": "a7f35f1a-1734-4a24-83b5-3c172f5f5aec"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:28.168893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:28.169584 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=8 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:28.175698 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-9526721d-ef16-44f0-b6f1-b65e3557911c req-788c7265-ac75-4ad3-af51-2a6de5b4fb83 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.176359 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-9526721d-ef16-44f0-b6f1-b65e3557911c req-788c7265-ac75-4ad3-af51-2a6de5b4fb83 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.187839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-9526721d-ef16-44f0-b6f1-b65e3557911c req-788c7265-ac75-4ad3-af51-2a6de5b4fb83 service nova] Creating event network-vif-plugged:a7f35f1a-1734-4a24-83b5-3c172f5f5aec for instance 444bf318-3448-4659-8480-c30aa659c5d6 on hv-cinder-78729 Jun 15 15:00:28.193388 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-9526721d-ef16-44f0-b6f1-b65e3557911c req-788c7265-ac75-4ad3-af51-2a6de5b4fb83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 Jun 15 15:00:28.193973 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 437/866] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:28.399588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:28.400340 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:28.407298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.407746 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.410341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.410341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.578517 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:28.586150 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-41ea73ad-c165-4882-b98e-893885cd82dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.190849 Jun 15 15:00:28.586728 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 430/867] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:28 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:29.604845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:29.605541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:29.612127 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.612577 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:29.613401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.613770 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:29.746262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:29.754931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-23239df1-6363-4adf-9a73-a6e07014d83f tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.155178 Jun 15 15:00:29.755624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 438/868] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:29 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:30.066110 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-28f588b2-706e-4ba0-8f98-6dc8998c50a8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:30.066681 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-28f588b2-706e-4ba0-8f98-6dc8998c50a8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:30.073187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28f588b2-706e-4ba0-8f98-6dc8998c50a8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.073640 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28f588b2-706e-4ba0-8f98-6dc8998c50a8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.074404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28f588b2-706e-4ba0-8f98-6dc8998c50a8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.074845 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-28f588b2-706e-4ba0-8f98-6dc8998c50a8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.097517 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-28f588b2-706e-4ba0-8f98-6dc8998c50a8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/ips" status: 200 len: 152 microversion: 2.20 time: 0.035394 Jun 15 15:00:30.098091 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 431/869] 10.222.0.42 () {60 vars in 1288 bytes} [Wed Jun 15 15:00:30 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:00:30.773496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:30.774287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:30.781354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.781920 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.782694 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.783131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.921374 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:30.928923 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8b13e826-387a-49c5-b87c-1173599954a1 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1314 microversion: 2.1 time: 0.160204 Jun 15 15:00:30.929484 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 439/870] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:30 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:31.946750 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:31.947422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:31.954934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.955382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.956185 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.956633 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.101206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:32.109022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-90335e64-994a-4956-9726-d7b4c645d8b4 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1499 microversion: 2.1 time: 0.166083 Jun 15 15:00:32.109683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 432/871] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:31 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:32.987775 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:32.988339 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:32.994956 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.995409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.996217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.996666 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.181006 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:00:33.310416 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:33.311251 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:33.318710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.319007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.325429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.325429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.349454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'flavor' on Instance uuid bb410306-baba-4584-9def-e17d53db3ce4 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:33.471641 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ff112da6-cf87-45c1-868e-fdb66dbd7977 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "DELETE /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 204 len: 0 microversion: 2.1 time: 0.487917 Jun 15 15:00:33.472160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 440/872] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:00:32 2022] DELETE /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:00:33.480471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:33.481978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:33.487965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.488442 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.489216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.489654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.624599 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:33.632472 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-de4f6c41-08d2-4f8a-b199-89c7ed7901dc tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1505 microversion: 2.1 time: 0.155913 Jun 15 15:00:33.633025 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 441/873] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:33 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:33.922756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-22bdf25c-9c28-45af-a0d1-dc33612502b1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/action" status: 202 len: 0 microversion: 2.20 time: 0.615931 Jun 15 15:00:33.923491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 433/874] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jun 15 15:00:33 2022] POST /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:00:33.932027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:33.932672 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:33.939501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.939953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.940748 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.941191 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.070557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.078098 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.079613 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.080809 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7b42028f-1e42-4783-b32a-21b9f3e81d50 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.153193 Jun 15 15:00:34.081356 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 442/875] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:33 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:34.651103 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:34.651801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:34.659087 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.659570 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.660332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.660764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.799575 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.807453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fb850df4-c463-4fa9-b9f9-a2956f6618ed tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1505 microversion: 2.1 time: 0.160930 Jun 15 15:00:34.807964 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 434/876] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:34 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:35.101515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:35.102073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:35.108828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.109274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.110210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.110687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.241324 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:35.249237 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:35.251806 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:35.253198 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e6aa46dc-9360-48b7-b151-2ff00dab34b6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.157808 Jun 15 15:00:35.254038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 443/877] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:35 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:35.824553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:35.825129 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:35.833399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.833859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.834652 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.835095 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.034975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:36.042390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-70aad708-3dfa-4eea-9635-8df1fd286559 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1505 microversion: 2.1 time: 0.221908 Jun 15 15:00:36.043001 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 435/878] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:35 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:36.272667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:36.273282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:36.273988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-235fabe4-87be-41f0-aa5a-7f99982f7ab8 req-72da9f7d-38c7-43cd-a839-87cc06cd6fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "444bf318-3448-4659-8480-c30aa659c5d6", "name": "network-vif-deleted", "tag": "a7f35f1a-1734-4a24-83b5-3c172f5f5aec"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:36.280293 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.280742 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.281518 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.282128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-235fabe4-87be-41f0-aa5a-7f99982f7ab8 req-72da9f7d-38c7-43cd-a839-87cc06cd6fb8 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.282386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.282592 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-235fabe4-87be-41f0-aa5a-7f99982f7ab8 req-72da9f7d-38c7-43cd-a839-87cc06cd6fb8 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.293980 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-235fabe4-87be-41f0-aa5a-7f99982f7ab8 req-72da9f7d-38c7-43cd-a839-87cc06cd6fb8 service nova] Creating event network-vif-deleted:a7f35f1a-1734-4a24-83b5-3c172f5f5aec for instance 444bf318-3448-4659-8480-c30aa659c5d6 on hv-cinder-78729 Jun 15 15:00:36.299787 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-235fabe4-87be-41f0-aa5a-7f99982f7ab8 req-72da9f7d-38c7-43cd-a839-87cc06cd6fb8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029220 Jun 15 15:00:36.300551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 436/879] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:36.421504 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:36.430212 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:36.431733 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:36.432955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f5c79d5-dc2e-4205-8364-2383d6d4ab3c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.165817 Jun 15 15:00:36.434210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 444/880] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:36 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:37.061555 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:37.062260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:37.069183 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.069651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.070420 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.070861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.105131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.105589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.106048 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lazy-loading 'fault' on Instance uuid 444bf318-3448-4659-8480-c30aa659c5d6 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:37.149929 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f42c17c1374253b7716ffe0ffbaa6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a0e27741434fd282a638aefa713c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:37.157580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-dd229ffb-94c6-49e8-9ac9-871e51d8bb50 tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 200 len: 1304 microversion: 2.1 time: 0.100662 Jun 15 15:00:37.160262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 437/881] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:37 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:37.451020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:37.451837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:37.459663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.461415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.461415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.461415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.665891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:37.674805 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:37.676403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:37.677574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a5c64db4-4f84-4595-8a92-31abc2e27a94 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.230602 Jun 15 15:00:37.678125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 445/882] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:37 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:38.175529 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:38.176158 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] [instance: 444bf318-3448-4659-8480-c30aa659c5d6] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:38.182783 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.183230 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.184028 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.184487 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.198349 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] HTTP exception thrown: Instance 444bf318-3448-4659-8480-c30aa659c5d6 could not be found. Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Request method failure captured: Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 HTTP/1.1 Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfPmjQEUznNP53XA_gRvp6MzDb6Z_bxdB0ETuevmFHW9D8L-UqdFc5rmH5DYMnB_jE4tCR52dtvEn74ox3vc_5f90OOJJRRcf9IvqYxtuKkRw0GxMw0xjyQiFApuYx6B8ixnhrBmfzo3-ys4F8YiH6PtpxdNWV8Bk08V9ncm1cFE1f8 Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: c0a0e27741434fd282a638aefa713c91 Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesActionsTest-2109529788 Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:00:38.200007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0a0e27741434fd282a638aefa713c91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0a0e27741434fd282a638aefa713c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0a0e27741434fd282a638aefa713c91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0a0e27741434fd282a638aefa713c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesActionsTest-2109529788 Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: c0a0e27741434fd282a638aefa713c91 Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesActionsTest-2109529788 Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesActionsTest-2109529788-project Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 33f42c17c1374253b7716ffe0ffbaa6d Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesActionsTest-2109529788-project Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 444bf318-3448-4659-8480-c30aa659c5d6 could not be found. Jun 15 15:00:38.201611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '444bf318-3448-4659-8480-c30aa659c5d6'} Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 444bf318-3448-4659-8480-c30aa659c5d6 could not be found. Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:38.202506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 444bf318-3448-4659-8480-c30aa659c5d6 could not be found. Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 444bf318-3448-4659-8480-c30aa659c5d6 could not be found. Jun 15 15:00:38.203998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:38.206594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] Returning 404 to user: Instance 444bf318-3448-4659-8480-c30aa659c5d6 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:38.206594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-408a365b-bdc7-45b0-8a2e-a5fa92d7751c tempest-VolumesActionsTest-2109529788 tempest-VolumesActionsTest-2109529788-project] 10.222.0.42 "GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6" status: 404 len: 111 microversion: 2.1 time: 0.030493 Jun 15 15:00:38.206594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 438/883] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:38 2022] GET /compute/v2.1/servers/444bf318-3448-4659-8480-c30aa659c5d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:38.696299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:38.697091 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:38.703875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.705071 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.705903 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.706424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.120225 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:39.130031 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:39.131533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:39.132751 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b697eae1-7cb0-4d0f-a025-b22612df3914 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.440662 Jun 15 15:00:39.133310 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 446/884] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:38 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:40.152572 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:40.153300 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:40.159884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:40.160370 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:40.161144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:40.161580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:40.291836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:40.300851 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:40.302459 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:40.303778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-55e8665a-d158-47ac-a58d-650c55e3d297 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.155336 Jun 15 15:00:40.304255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 439/885] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:40 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:41.322587 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:41.323223 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:41.330120 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.330789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.331754 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.332242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.477103 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:41.487900 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:41.489908 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:41.491300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-386c578c-4207-4315-b94a-f28c169ab0b5 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.172662 Jun 15 15:00:41.491975 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 447/886] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:41 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:42.523674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:42.534458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:42.534458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:42.534458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:42.534458 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:42.534860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:42.665350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:42.673484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:42.675859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:42.677106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ed9d59e5-4238-42ab-b428-086eade4a654 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.157403 Jun 15 15:00:42.677639 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 440/887] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:42 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:43.695894 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:43.696551 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:43.703713 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:43.704194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:43.705007 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:43.705617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:43.835505 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:43.843505 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:43.845046 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:43.846784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-afc67c55-b154-4c1f-8eed-2f8cf6681f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.154876 Jun 15 15:00:43.847342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 448/888] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:43 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:44.871855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:44.871855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:44.872531 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:44.872936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:44.873697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:44.874130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:45.009577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:45.017573 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:45.019581 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:45.020802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-891e4efb-3389-4e4e-961d-f80d58b2d24c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.159476 Jun 15 15:00:45.021432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 441/889] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:44 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:46.042164 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:46.043144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:46.050909 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:46.051359 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:46.052153 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:46.052594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:46.207012 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:46.221155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:46.223470 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:46.225756 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-087dffc3-4960-4f79-b8b9-9e3e2b90c739 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.188298 Jun 15 15:00:46.226826 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 449/890] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:46 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:00:47.246199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:47.246802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:47.254884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:47.255359 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:47.256647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:47.256647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:47.534567 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:47.547471 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:47.551940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:47.557850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bfa7c81b-568d-41b5-88fc-4ce72ee005f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.315432 Jun 15 15:00:47.559130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 442/891] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:47 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:48.062610 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:48.068365 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:48.083881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.085161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.088390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.089732 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.132547 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:00:48.179644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-b1658ff0-977a-413a-be8e-9ff547466d53 req-1c727e02-35f8-4f75-a220-ac6a024b719e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5cf910-fe77-4ed2-9851-6b5a45f93c80", "tag": "5b0dddd1-2896-4186-9fd4-38e802bca5a6"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:48.190664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-b1658ff0-977a-413a-be8e-9ff547466d53 req-1c727e02-35f8-4f75-a220-ac6a024b719e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.191558 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-b1658ff0-977a-413a-be8e-9ff547466d53 req-1c727e02-35f8-4f75-a220-ac6a024b719e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.196685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:48.207769 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-b1658ff0-977a-413a-be8e-9ff547466d53 req-1c727e02-35f8-4f75-a220-ac6a024b719e service nova] Creating event network-changed:5b0dddd1-2896-4186-9fd4-38e802bca5a6 for instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 on hv-cinder-78729 Jun 15 15:00:48.216379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-b1658ff0-977a-413a-be8e-9ff547466d53 req-1c727e02-35f8-4f75-a220-ac6a024b719e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137053 Jun 15 15:00:48.218253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 443/892] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:48.546588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cf184a37-cfee-4ed3-a069-8c00c96cf0a5 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 204 len: 0 microversion: 2.1 time: 0.492331 Jun 15 15:00:48.547425 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 450/893] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:00:48 2022] DELETE /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:00:48.569321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:48.570218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:48.579025 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:48.580890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:48.583243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.584105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.586134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.586714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.593661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.594387 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.596109 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.598502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.911702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:48.928264 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1b1ce2c0-a426-4e2a-9d55-a4a7494df2a8 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.369333 Jun 15 15:00:48.929757 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 444/894] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:48 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:48.937323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:48.949428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:48.951497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:48.952872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f2cd7f7e-1402-43f9-a391-170c59fdcc7c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.378702 Jun 15 15:00:48.953759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 451/895] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:48 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:49.951416 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:49.952356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:49.961105 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.961591 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.962722 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.963169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.971653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:49.972452 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:49.984961 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.986053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.989349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.989994 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:50.289675 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:50.290369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:50.292654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:50.299836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7336a32e-cd68-4d08-9f1d-fb9e7853131a tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.352762 Jun 15 15:00:50.302448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 445/896] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:49 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:50.309906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:50.309906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:50.309906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cb8a6717-db5f-4deb-afbf-a0c438be2257 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.338807 Jun 15 15:00:50.310220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 452/897] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:49 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:51.336430 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:51.337675 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:51.338436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:51.339169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:51.346148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.351061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.351061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.351061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.351363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.351363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.351936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.352777 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.728848 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.741243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-17baa9cd-9b25-4e35-898a-d3e54dac32d3 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1568 microversion: 2.1 time: 0.409446 Jun 15 15:00:51.742107 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 453/898] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:51 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1568 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:51.746833 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ca75cb67-707a-4bc7-8347-b69f18ced5fd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:51.747343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ca75cb67-707a-4bc7-8347-b69f18ced5fd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:51.767995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca75cb67-707a-4bc7-8347-b69f18ced5fd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.768528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca75cb67-707a-4bc7-8347-b69f18ced5fd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.769349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca75cb67-707a-4bc7-8347-b69f18ced5fd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.769801 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ca75cb67-707a-4bc7-8347-b69f18ced5fd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.791216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.800654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.802208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.803738 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2933efe6-6f7f-4392-8bfa-d9d1c0fc80c0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.472343 Jun 15 15:00:51.809224 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 446/899] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:51 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:51.826112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ca75cb67-707a-4bc7-8347-b69f18ced5fd tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/ips" status: 200 len: 146 microversion: 2.1 time: 0.082908 Jun 15 15:00:51.827004 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 454/900] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 15:00:51 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/ips => generated 146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:52.433204 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-1f392d4d-d0a4-4c00-a161-37d9bbfac0c6 req-0aadc869-8674-4c4a-b189-8c68bbced03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5cf910-fe77-4ed2-9851-6b5a45f93c80", "name": "network-vif-deleted", "tag": "5b0dddd1-2896-4186-9fd4-38e802bca5a6"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:52.442857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-1f392d4d-d0a4-4c00-a161-37d9bbfac0c6 req-0aadc869-8674-4c4a-b189-8c68bbced03d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.443302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-1f392d4d-d0a4-4c00-a161-37d9bbfac0c6 req-0aadc869-8674-4c4a-b189-8c68bbced03d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.454960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-1f392d4d-d0a4-4c00-a161-37d9bbfac0c6 req-0aadc869-8674-4c4a-b189-8c68bbced03d service nova] Creating event network-vif-deleted:5b0dddd1-2896-4186-9fd4-38e802bca5a6 for instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 on hv-cinder-78729 Jun 15 15:00:52.460376 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-1f392d4d-d0a4-4c00-a161-37d9bbfac0c6 req-0aadc869-8674-4c4a-b189-8c68bbced03d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109494 Jun 15 15:00:52.460979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 447/901] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:52.762614 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:52.763466 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:52.772862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.775831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.775831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.775831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.833213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:52.834223 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:52.848102 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.849283 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.853046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.854888 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.863140 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:52.875646 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-90928399-e098-4a53-90e2-8c43a18f00e7 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1220 microversion: 2.1 time: 0.119766 Jun 15 15:00:52.877124 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 455/902] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:52 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:53.059332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:53.068596 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:53.070096 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:53.071543 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1d68ec5b-82ba-4b16-a3c9-0bda22a24738 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1746 microversion: 2.20 time: 0.247669 Jun 15 15:00:53.072421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 448/903] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:52 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1746 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:53.894287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:53.895631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:53.903886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:53.904979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:53.906027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:53.906699 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:53.943620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:53.944522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:53.945212 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lazy-loading 'fault' on Instance uuid 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:54.003738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e682af1a7f493c992509142b673932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3340f5c4bac49cfaaaa0d80b1bfbb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:54.014448 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0ee0e0da-ac98-48a4-8f18-69892747aa02 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 200 len: 1225 microversion: 2.1 time: 0.123773 Jun 15 15:00:54.015179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 456/904] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:53 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:54.090008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:54.090833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:54.097979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:54.098822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:54.099822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:54.100478 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:54.250976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:54.260130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:54.261706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:54.262892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a509bacd-b3c0-4a61-b9f3-c2ac9a48efb0 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1746 microversion: 2.20 time: 0.176855 Jun 15 15:00:54.263530 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 449/905] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:54 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:54.910081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-68f43e48-4e66-4a81-8bb0-879d6b4acb28 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29ce362f-695f-4c4e-8cbe-18b5f5635e54"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:54.912335 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-68f43e48-4e66-4a81-8bb0-879d6b4acb28 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:54.922771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68f43e48-4e66-4a81-8bb0-879d6b4acb28 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:54.926957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68f43e48-4e66-4a81-8bb0-879d6b4acb28 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:54.926957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68f43e48-4e66-4a81-8bb0-879d6b4acb28 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:54.926957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68f43e48-4e66-4a81-8bb0-879d6b4acb28 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:55.035835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:55.037954 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] [instance: 1f5cf910-fe77-4ed2-9851-6b5a45f93c80] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:55.042206 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=46 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:55.049330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:55.049330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:55.049330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:55.050786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:55.080416 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] HTTP exception thrown: Instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 could not be found. Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Request method failure captured: Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 HTTP/1.1 Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfJ6hTV1mraPSm-j2bbt_ilzsPEjnFP4i-iKEMjUjvVtg3qqmWLWYm61CQRVmjZQA5HlztphyRT3jWg4G4Rytr-PGEOD_5RdeXsr_fB0HbfLz363O46LNFP8tlFYxOe3aR1fBgDoJtOmGeTMvbnS5X9qwCL0bi44A5LVXOn0NY5J1dE Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: f3340f5c4bac49cfaaaa0d80b1bfbb4a Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-TestShelveInstance-487159388 Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:00:55.082550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3340f5c4bac49cfaaaa0d80b1bfbb4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3340f5c4bac49cfaaaa0d80b1bfbb4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3340f5c4bac49cfaaaa0d80b1bfbb4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3340f5c4bac49cfaaaa0d80b1bfbb4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-TestShelveInstance-487159388 Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: f3340f5c4bac49cfaaaa0d80b1bfbb4a Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-TestShelveInstance-487159388 Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-TestShelveInstance-487159388-project Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: a0e682af1a7f493c992509142b673932 Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-TestShelveInstance-487159388-project Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 could not be found. Jun 15 15:00:55.084405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '1f5cf910-fe77-4ed2-9851-6b5a45f93c80'} Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 could not be found. Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:55.085399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 could not be found. Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 could not be found. Jun 15 15:00:55.087211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:00:55.089825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Returning 404 to user: Instance 1f5cf910-fe77-4ed2-9851-6b5a45f93c80 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:55.091070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-17e59051-da6c-433f-80d9-f0886261f4dc tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80" status: 404 len: 111 microversion: 2.1 time: 0.059695 Jun 15 15:00:55.097051 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 450/906] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:55 2022] GET /compute/v2.1/servers/1f5cf910-fe77-4ed2-9851-6b5a45f93c80 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:55.283564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:55.284838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:55.295726 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:55.298365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:55.298365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:55.298365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:55.487990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:55.499856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:55.502748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:55.503897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7478c0ef-52d4-4df9-ae11-bfc280beac5c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1746 microversion: 2.20 time: 0.225832 Jun 15 15:00:55.507797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 451/907] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:55 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:55.513736 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-10af5fe3-7f6a-4340-a744-7d67a504b706 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] Calling method '.version_select at 0x7fb8a8dc68b0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:55.632716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-10af5fe3-7f6a-4340-a744-7d67a504b706 tempest-TestShelveInstance-487159388 tempest-TestShelveInstance-487159388-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1231359926" status: 202 len: 0 microversion: 2.1 time: 0.123605 Jun 15 15:00:55.636896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 452/908] 10.222.0.42 () {58 vars in 1253 bytes} [Wed Jun 15 15:00:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1231359926 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:55.761918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-68f43e48-4e66-4a81-8bb0-879d6b4acb28 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859301 Jun 15 15:00:55.762682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 457/909] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:00:54 2022] POST /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:56.536453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:56.543338 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:56.552949 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:56.553521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:56.554476 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:56.555897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:56.778521 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:56.788295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:56.790213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:56.791603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d1bed0fd-0b25-4422-a182-a4a18f10c83e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1746 microversion: 2.20 time: 0.268789 Jun 15 15:00:56.792562 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 453/910] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:56 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1746 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:57.816216 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:57.818861 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:57.835557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:57.836421 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:57.840639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:57.841951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:58.130245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:58.150296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:58.152560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:58.160055 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-124110f9-19ed-4d4c-8407-63a2c63c7c1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1746 microversion: 2.20 time: 0.345731 Jun 15 15:00:58.160055 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 458/911] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:57 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1746 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:58.410519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-fde45f74-32a2-49c8-b525-d5bee87272f8 req-4f09bd0b-1016-4db1-ac3b-1d5cafe70f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb410306-baba-4584-9def-e17d53db3ce4", "name": "network-vif-plugged", "status": "completed", "tag": "64b622a1-14da-45ed-a6c9-adcf5f16d5aa"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:58.425308 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-fde45f74-32a2-49c8-b525-d5bee87272f8 req-4f09bd0b-1016-4db1-ac3b-1d5cafe70f67 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:58.426128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-fde45f74-32a2-49c8-b525-d5bee87272f8 req-4f09bd0b-1016-4db1-ac3b-1d5cafe70f67 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:58.445858 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-fde45f74-32a2-49c8-b525-d5bee87272f8 req-4f09bd0b-1016-4db1-ac3b-1d5cafe70f67 service nova] Creating event network-vif-plugged:64b622a1-14da-45ed-a6c9-adcf5f16d5aa for instance bb410306-baba-4584-9def-e17d53db3ce4 on hv-cinder-78729 Jun 15 15:00:58.453718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-fde45f74-32a2-49c8-b525-d5bee87272f8 req-4f09bd0b-1016-4db1-ac3b-1d5cafe70f67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048102 Jun 15 15:00:58.456003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 454/912] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:59.180064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:59.180818 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:59.188362 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:59.192302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:59.192759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:59.193543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:59.193983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:59.397463 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:59.410729 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:59.414689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:59.416042 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a973cd45-75a7-436b-8737-e78248217bdb tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1746 microversion: 2.20 time: 0.246649 Jun 15 15:00:59.417089 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 459/913] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:59 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1746 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:00.436021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:00.437591 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:00.456008 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:00.460509 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:00.462703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:00.463514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:00.702228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:00.718651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:00.720790 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:00.722853 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2f3e1e7e-5f75-4c4b-925e-87b4e7876285 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1746 microversion: 2.20 time: 0.291610 Jun 15 15:01:00.723453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 455/914] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:00 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1746 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:01.763769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:01.796488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:01.824933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:01.826224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:01.827303 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:01.828025 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:02.177596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:02.191983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:02.195760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:02.200626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fe14ca80-0d2d-4d36-87be-df5e8c0e7597 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.459052 Jun 15 15:01:02.201934 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 460/915] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:01 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:03.223983 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:03.224688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:03.236716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:03.237173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:03.237978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:03.238421 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:03.591518 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:03.606121 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:03.608318 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:03.609800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0e5e8186-09ad-419b-8fb3-21ae91bf7ff8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.392895 Jun 15 15:01:03.610714 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 456/916] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:03 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:04.634220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:04.635949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:04.648169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:04.648682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:04.671359 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:04.673106 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:04.921773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-200ce7a6-edf5-489c-9471-95090ecbb5a8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:04.924342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-200ce7a6-edf5-489c-9471-95090ecbb5a8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:04.941890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-200ce7a6-edf5-489c-9471-95090ecbb5a8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:04.942681 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-200ce7a6-edf5-489c-9471-95090ecbb5a8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:04.943897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-200ce7a6-edf5-489c-9471-95090ecbb5a8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:04.944543 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-200ce7a6-edf5-489c-9471-95090ecbb5a8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:05.018187 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-200ce7a6-edf5-489c-9471-95090ecbb5a8 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097550 Jun 15 15:01:05.030409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 457/917] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:04 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:05.040023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a84164c-07d7-4fd4-a3d2-63a4e152e2eb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:05.045097 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a84164c-07d7-4fd4-a3d2-63a4e152e2eb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:05.055815 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a84164c-07d7-4fd4-a3d2-63a4e152e2eb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:05.056835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a84164c-07d7-4fd4-a3d2-63a4e152e2eb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:05.058177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a84164c-07d7-4fd4-a3d2-63a4e152e2eb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:05.058989 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a84164c-07d7-4fd4-a3d2-63a4e152e2eb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:05.107054 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a84164c-07d7-4fd4-a3d2-63a4e152e2eb tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/29ce362f-695f-4c4e-8cbe-18b5f5635e54" status: 200 len: 194 microversion: 2.1 time: 0.074687 Jun 15 15:01:05.116894 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 458/918] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jun 15 15:01:05 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/29ce362f-695f-4c4e-8cbe-18b5f5635e54 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:05.271361 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:05.287812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:05.295217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:05.299883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-26f326cc-cb0b-484e-9a6a-c778bbf0482d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.673742 Jun 15 15:01:05.303350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 461/919] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:04 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:06.325505 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:06.326128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:06.337401 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:06.338170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:06.338976 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:06.339420 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:06.542881 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:06.555885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:06.559185 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:06.561056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ef96dec2-dcd0-4cb2-a521-ee104b7fb595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.243064 Jun 15 15:01:06.576903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 459/920] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:06 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:07.589647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:07.592533 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:07.640448 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:07.645250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:07.655960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:07.657211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:08.131328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:08.148394 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:08.151440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:08.163116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9d258c82-de7a-46ce-8c6b-fe5ac917a1aa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.580288 Jun 15 15:01:08.175282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 462/921] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:07 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:08.225886 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7c0693bc-af44-443c-8ebf-f9e610f0d4c2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bda93e86-088c-4095-b637-7e22c900e641"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:08.226991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7c0693bc-af44-443c-8ebf-f9e610f0d4c2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:08.238341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c0693bc-af44-443c-8ebf-f9e610f0d4c2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:08.240453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c0693bc-af44-443c-8ebf-f9e610f0d4c2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:08.240829 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c0693bc-af44-443c-8ebf-f9e610f0d4c2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:08.241461 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c0693bc-af44-443c-8ebf-f9e610f0d4c2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:09.134520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7c0693bc-af44-443c-8ebf-f9e610f0d4c2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "POST /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.910945 Jun 15 15:01:09.134999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 460/922] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:01:08 2022] POST /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments => generated 194 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:09.183008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:09.184400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:09.195464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:09.200926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:09.205589 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:09.207452 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:09.513316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:09.543465 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:09.547919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:09.580386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-94569b76-0e6e-4d83-a214-b1e693f6ad1d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.374326 Jun 15 15:01:09.582125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 463/923] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:09 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:10.589653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:10.590669 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:10.602498 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:10.603428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:10.605375 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:10.606060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:10.839176 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:10.848973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:10.850806 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:10.852559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-dc70c119-374e-41bc-8626-ea119a22db48 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.269202 Jun 15 15:01:10.863832 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 461/924] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:10 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:11.873094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:11.874941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:11.886949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:11.888261 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:11.889502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:11.890140 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:12.054178 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:12.064268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:12.065990 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:12.067262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b8258f29-deb8-44df-b000-115495966599 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.199904 Jun 15 15:01:12.068119 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 464/925] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:11 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:13.086250 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:13.086885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:13.108554 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:13.109309 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:13.110331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:13.111756 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:13.305542 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:13.315571 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:13.317123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:13.318416 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-afc79aa8-e5ca-4329-a8be-fe29bbd5698f tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.236413 Jun 15 15:01:13.319439 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 462/926] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:13 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:14.338131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:14.339029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:14.347808 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:14.348763 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:14.350308 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:14.350947 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:14.354780 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:14.530721 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:14.540189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:14.541711 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:14.542897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-66722951-a726-4ce3-99ef-42ac1be8d22b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.208776 Jun 15 15:01:14.543500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 465/927] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:14 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:15.565571 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:15.566525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:15.572765 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:15.573311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:15.574152 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:15.574664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:15.715271 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:15.724803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:15.726343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:15.727516 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3c0289ba-725b-46fb-b1b5-4e8e6b8093da tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.167782 Jun 15 15:01:15.728078 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 463/928] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:15 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:16.746458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:16.747347 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:16.755337 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.755789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.756613 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.757051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.898856 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:16.906995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:16.909052 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:16.910230 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2db3b5f6-5acd-4be5-b2da-de69a3837772 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1741 microversion: 2.20 time: 0.167948 Jun 15 15:01:16.915211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 466/929] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:16 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:17.931193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:17.931193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:17.944489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:17.944973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:17.945770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:17.946209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:17.952323 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:18.121875 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:18.133098 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:18.135262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:18.136618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fcde92cd-c0f8-4cb4-96f5-74eba5946a13 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1723 microversion: 2.20 time: 0.211495 Jun 15 15:01:18.137499 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 464/930] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:17 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:19.182810 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:19.184462 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:19.213636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.213636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.213636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.213636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.258955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-54f7bc9e-c5c1-48b8-9d0e-7308ab292349 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:19.260701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-54f7bc9e-c5c1-48b8-9d0e-7308ab292349 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:19.270003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-54f7bc9e-c5c1-48b8-9d0e-7308ab292349 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.270739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-54f7bc9e-c5c1-48b8-9d0e-7308ab292349 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.273981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-54f7bc9e-c5c1-48b8-9d0e-7308ab292349 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.276679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-54f7bc9e-c5c1-48b8-9d0e-7308ab292349 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.333408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-54f7bc9e-c5c1-48b8-9d0e-7308ab292349 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.078716 Jun 15 15:01:19.341876 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 465/931] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:19 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:19.428517 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:19.437111 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:19.439446 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:19.440818 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a0cf94e4-172c-4414-8b49-37315bdfd892 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1723 microversion: 2.20 time: 0.273021 Jun 15 15:01:19.441412 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 467/932] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:19 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:19.479865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9695eb3d-4874-4e30-8994-77a18787ca74 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:19.480419 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9695eb3d-4874-4e30-8994-77a18787ca74 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:19.489069 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9695eb3d-4874-4e30-8994-77a18787ca74 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.494491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9695eb3d-4874-4e30-8994-77a18787ca74 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.494491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9695eb3d-4874-4e30-8994-77a18787ca74 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.494491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9695eb3d-4874-4e30-8994-77a18787ca74 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.541914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9695eb3d-4874-4e30-8994-77a18787ca74 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/29ce362f-695f-4c4e-8cbe-18b5f5635e54" status: 200 len: 194 microversion: 2.1 time: 0.051758 Jun 15 15:01:19.541914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 466/933] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jun 15 15:01:19 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/29ce362f-695f-4c4e-8cbe-18b5f5635e54 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:19.542606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:19.542606 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:19.550391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.551101 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.552126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.552732 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.656865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lazy-loading 'services' on Instance uuid f44bf928-fd4e-4132-93a4-286add941a90 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:19.842493 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f8abd208-0dce-4dcc-ae7e-be8b8d95a398 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/29ce362f-695f-4c4e-8cbe-18b5f5635e54" status: 202 len: 0 microversion: 2.1 time: 0.307543 Jun 15 15:01:19.843127 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 468/934] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 15:01:19 2022] DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/29ce362f-695f-4c4e-8cbe-18b5f5635e54 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:01:20.259417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-52afa6a2-bc26-4af7-b357-54a7e1ce9d9b req-887b48b3-6737-4de2-94b5-9eb56e1f9cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb410306-baba-4584-9def-e17d53db3ce4", "name": "network-vif-unplugged", "status": "completed", "tag": "64b622a1-14da-45ed-a6c9-adcf5f16d5aa"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:20.274901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-52afa6a2-bc26-4af7-b357-54a7e1ce9d9b req-887b48b3-6737-4de2-94b5-9eb56e1f9cfb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:20.275730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-52afa6a2-bc26-4af7-b357-54a7e1ce9d9b req-887b48b3-6737-4de2-94b5-9eb56e1f9cfb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:20.289083 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-52afa6a2-bc26-4af7-b357-54a7e1ce9d9b req-887b48b3-6737-4de2-94b5-9eb56e1f9cfb service nova] Creating event network-vif-unplugged:64b622a1-14da-45ed-a6c9-adcf5f16d5aa for instance bb410306-baba-4584-9def-e17d53db3ce4 on hv-cinder-78729 Jun 15 15:01:20.294861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-52afa6a2-bc26-4af7-b357-54a7e1ce9d9b req-887b48b3-6737-4de2-94b5-9eb56e1f9cfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044520 Jun 15 15:01:20.296074 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 467/935] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:20.459681 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:20.461252 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:20.468829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:20.469831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:20.471083 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:20.471461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:20.641049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:20.653744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:20.655295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:20.656660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-25b58222-dc3d-4e34-9f95-cbe68268159a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1723 microversion: 2.20 time: 0.201326 Jun 15 15:01:20.657753 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 469/936] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:20 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:21.678676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:21.680873 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:21.690890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:21.691624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:21.692534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:21.692978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:21.841424 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:21.858140 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:21.859648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:21.862172 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5b5be250-d70c-4341-a09e-31ac52e52595 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1723 microversion: 2.20 time: 0.187926 Jun 15 15:01:21.869266 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 468/937] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:21 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:22.882357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:22.882947 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:22.890978 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.892003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.893159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.893494 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.042378 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:23.050891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:23.052483 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:23.056799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-68d30b07-b6d8-4189-9335-4a840c62ff17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1726 microversion: 2.20 time: 0.175788 Jun 15 15:01:23.056799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 470/938] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:22 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:23.074188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b15c95f4-818c-49d2-b5b1-e6d98ecef9d2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73fe6087-fd8d-4326-ba90-26c812bcdf31"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:23.074188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b15c95f4-818c-49d2-b5b1-e6d98ecef9d2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:23.080636 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b15c95f4-818c-49d2-b5b1-e6d98ecef9d2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.081341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b15c95f4-818c-49d2-b5b1-e6d98ecef9d2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.082137 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b15c95f4-818c-49d2-b5b1-e6d98ecef9d2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.082814 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b15c95f4-818c-49d2-b5b1-e6d98ecef9d2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.117270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f9d504bd-8b85-42ac-8e4e-613114b29f48 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:23.118075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f9d504bd-8b85-42ac-8e4e-613114b29f48 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:23.127481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9d504bd-8b85-42ac-8e4e-613114b29f48 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.128158 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9d504bd-8b85-42ac-8e4e-613114b29f48 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.129119 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9d504bd-8b85-42ac-8e4e-613114b29f48 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.130028 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f9d504bd-8b85-42ac-8e4e-613114b29f48 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.171393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f9d504bd-8b85-42ac-8e4e-613114b29f48 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/bda93e86-088c-4095-b637-7e22c900e641" status: 200 len: 194 microversion: 2.1 time: 0.051878 Jun 15 15:01:23.171393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 471/939] 10.222.0.42 () {58 vars in 1412 bytes} [Wed Jun 15 15:01:23 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/bda93e86-088c-4095-b637-7e22c900e641 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:23.178802 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:23.179433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:23.189287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.189936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.190791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.191340 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.292458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lazy-loading 'services' on Instance uuid f44bf928-fd4e-4132-93a4-286add941a90 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:23.618859 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bae617db-b384-4fff-a81c-7e8fd444a131 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/bda93e86-088c-4095-b637-7e22c900e641" status: 202 len: 0 microversion: 2.1 time: 0.445042 Jun 15 15:01:23.619469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 472/940] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 15:01:23 2022] DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments/bda93e86-088c-4095-b637-7e22c900e641 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:01:24.475881 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b15c95f4-818c-49d2-b5b1-e6d98ecef9d2 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.407714 Jun 15 15:01:24.476526 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 469/941] 10.222.0.42 () {62 vars in 1363 bytes} [Wed Jun 15 15:01:23 2022] POST /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-volume_attachments => generated 188 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:01:24.624460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f98d1a9f-17ac-4b9c-8006-865cf49a40a7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:24.625301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f98d1a9f-17ac-4b9c-8006-865cf49a40a7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:24.631985 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f98d1a9f-17ac-4b9c-8006-865cf49a40a7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:24.632464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f98d1a9f-17ac-4b9c-8006-865cf49a40a7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:24.633240 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f98d1a9f-17ac-4b9c-8006-865cf49a40a7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:24.633677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f98d1a9f-17ac-4b9c-8006-865cf49a40a7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:25.488956 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f98d1a9f-17ac-4b9c-8006-865cf49a40a7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-volume_attachments/73fe6087-fd8d-4326-ba90-26c812bcdf31" status: 202 len: 0 microversion: 2.20 time: 0.867060 Jun 15 15:01:25.489488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 473/942] 10.222.0.42 () {60 vars in 1456 bytes} [Wed Jun 15 15:01:24 2022] DELETE /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-volume_attachments/73fe6087-fd8d-4326-ba90-26c812bcdf31 => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:01:25.591231 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:25.591807 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:25.596559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:25.602858 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:25.603319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:25.604119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:25.604749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:25.889760 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [3d97cff3-aa44-439e-9f7a-e1df64fdecfd] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 15:01:25.930893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3fd11de9-ea68-4103-ac2e-3726ebd3d5b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:25.932162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3fd11de9-ea68-4103-ac2e-3726ebd3d5b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:25.941402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fd11de9-ea68-4103-ac2e-3726ebd3d5b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:25.941402 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fd11de9-ea68-4103-ac2e-3726ebd3d5b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:25.942280 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fd11de9-ea68-4103-ac2e-3726ebd3d5b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:25.942614 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fd11de9-ea68-4103-ac2e-3726ebd3d5b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:25.975921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3fd11de9-ea68-4103-ac2e-3726ebd3d5b2 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061103 Jun 15 15:01:25.990623 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 474/943] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:25 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 15:01:26.147450 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-19a76e12-b732-47bd-a568-91c05f940ce9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:26.148433 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-19a76e12-b732-47bd-a568-91c05f940ce9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:26.157954 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19a76e12-b732-47bd-a568-91c05f940ce9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.158703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19a76e12-b732-47bd-a568-91c05f940ce9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.172212 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19a76e12-b732-47bd-a568-91c05f940ce9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.173718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-19a76e12-b732-47bd-a568-91c05f940ce9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.273029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-19a76e12-b732-47bd-a568-91c05f940ce9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129839 Jun 15 15:01:26.276382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 475/944] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:26 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:01:26.386387 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:26.387439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:26.397239 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.400231 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.403580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.404210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.462688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:01:26.506573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:26.775988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1f19a42c-1d14-45c0-a35e-08a990c7e3f6 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 204 len: 0 microversion: 2.1 time: 0.391133 Jun 15 15:01:26.781323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 476/945] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:26 2022] DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:01:26.790889 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:26.790889 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:26.799164 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.799860 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.800762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.801304 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.903974 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [3d97cff3-aa44-439e-9f7a-e1df64fdecfd] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43248. Jun 15 15:01:26.908062 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-92355396-689f-46a3-afa5-c295c3b56c43 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "POST /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/action" status: 202 len: 0 microversion: 2.20 time: 1.320855 Jun 15 15:01:26.912838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 470/946] 10.222.0.42 () {62 vars in 1318 bytes} [Wed Jun 15 15:01:25 2022] POST /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/action => generated 0 bytes in 1323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:01:26.925378 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:26.925484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:26.932285 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.932738 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.933517 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.933948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.988628 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:26.996872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4f778a32-5ddd-4241-a97b-9a3e0f90c106 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1674 microversion: 2.1 time: 0.213350 Jun 15 15:01:26.998078 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 477/947] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:26 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:27.104284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:27.113740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:27.115687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:27.117328 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d4302066-67db-4f80-b209-01538e9217f3 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1674 microversion: 2.20 time: 0.197752 Jun 15 15:01:27.118335 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 471/948] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:26 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:28.016707 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:28.018762 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:28.034645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.038697 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.039621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.040113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.144900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:28.145534 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:28.154721 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.155956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.156872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.157528 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.263634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:28.275721 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-faeace60-6eae-48b5-ac2f-bb519fd72cd1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1674 microversion: 2.1 time: 0.264268 Jun 15 15:01:28.276351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 478/949] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:28 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:28.399441 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:28.413443 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:28.414986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:28.416196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b285a581-8d9a-4fa3-b353-ba0dafccf01b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1674 microversion: 2.20 time: 0.282402 Jun 15 15:01:28.417274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 472/950] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:28 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1674 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:29.296580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:29.298148 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:29.301150 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:29.324420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:29.326976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:29.328277 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:29.331913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:29.435839 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:29.436525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:29.456960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:29.457428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:29.458318 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:29.458776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.008265 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:30.025292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d430eb9c-8891-4080-b031-825aec00f74a tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1674 microversion: 2.1 time: 0.726667 Jun 15 15:01:30.026143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 479/951] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:29 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1674 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:30.030544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:30.040549 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:30.042093 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:30.043334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3d297f14-60b1-4112-b584-15d2a83a6f97 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1676 microversion: 2.20 time: 0.612022 Jun 15 15:01:30.052317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 473/952] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:29 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1676 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:30.312534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-880aa22d-a464-460f-a53f-27223263ef5f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Action: 'create', calling method: .version_select at 0x7fb8acc03ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-993253485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYdog0OJ9cDR2oXSVcTLxFkdtPFPOSAVHqoU5bhutwTTEzRUMfwRacEMZ3BTeti70cx7RG45ukq2YRAigbaUxC7zD2riqKM2mw5W36o8y8Mo8E0HkTB5n2esfrizburXQ=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:30.331902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-880aa22d-a464-460f-a53f-27223263ef5f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:30.336945 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-880aa22d-a464-460f-a53f-27223263ef5f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for user e209ae2f7fa7412b95c7c43c74c14426 and project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:30.356071 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR oslo.messaging._drivers.impl_rabbit [None req-880aa22d-a464-460f-a53f-27223263ef5f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [9af3e9e8-e67f-4c47-9f65-0258b07f1588] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 15:01:30.424072 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-30b78420-bac6-4ca9-a951-5f2c595a0ed6 req-8947089a-e5f5-49e3-9075-2e9ac0645bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44bf928-fd4e-4132-93a4-286add941a90", "name": "network-vif-deleted", "tag": "2cb63a99-4c69-4acc-8e82-ac92585111c9"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:30.438683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-30b78420-bac6-4ca9-a951-5f2c595a0ed6 req-8947089a-e5f5-49e3-9075-2e9ac0645bb7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:30.439851 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-30b78420-bac6-4ca9-a951-5f2c595a0ed6 req-8947089a-e5f5-49e3-9075-2e9ac0645bb7 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.459007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-30b78420-bac6-4ca9-a951-5f2c595a0ed6 req-8947089a-e5f5-49e3-9075-2e9ac0645bb7 service nova] Creating event network-vif-deleted:2cb63a99-4c69-4acc-8e82-ac92585111c9 for instance f44bf928-fd4e-4132-93a4-286add941a90 on hv-cinder-78729 Jun 15 15:01:30.466965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-30b78420-bac6-4ca9-a951-5f2c595a0ed6 req-8947089a-e5f5-49e3-9075-2e9ac0645bb7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046298 Jun 15 15:01:30.467991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 474/953] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:31.044587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:31.045605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:31.053554 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.054310 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.055274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.055913 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.091548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.092003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.092503 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lazy-loading 'fault' on Instance uuid f44bf928-fd4e-4132-93a4-286add941a90 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:31.142929 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0650eb65117a4e27908c4355bfc46c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175b90b822a942bd8e04b8ad7d228a57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:31.151538 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6df7bbf1-2242-4aca-9e19-ee8b75059fc9 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 200 len: 1327 microversion: 2.1 time: 0.111236 Jun 15 15:01:31.160333 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 475/954] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:31 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:31.166293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:31.167148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:31.174654 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.175106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.175955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.176424 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.337268 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:31.348077 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:31.350045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:31.351260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e0edbbb9-b28f-412e-bff7-bacfd8a3eefe tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.189549 Jun 15 15:01:31.351981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 476/955] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:31 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:31.366404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [None req-880aa22d-a464-460f-a53f-27223263ef5f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [9af3e9e8-e67f-4c47-9f65-0258b07f1588] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43300. Jun 15 15:01:31.478650 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-880aa22d-a464-460f-a53f-27223263ef5f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.315908 Jun 15 15:01:31.479327 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 480/956] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 15:01:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:32.170471 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:32.176629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:32.196689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.197517 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:32.204369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.204369 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:32.220559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] HTTP exception thrown: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Request method failure captured: Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 HTTP/1.1 Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGqrgGokbV2c9gtSCqVCRsKr0d_vzUe0Lj7ZuxV26CeHtGfo2bpR7uz5BdE_f_AJXO4vbVVG_l2eQ9IG6StwlG_BOYoHQPE9V3GNSyoJ_mUpOkMCp8WmcebLNHeJt1mer2Ttqa2616gzyfP-u9VtuuVwNwKPtRoXqiHJzI6pa3FJPY Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:01:32.223186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 0650eb65117a4e27908c4355bfc46c3b Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:32.224940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'f44bf928-fd4e-4132-93a4-286add941a90'} Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:32.225837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:32.227409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.230311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Returning 404 to user: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:32.231357 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f2b548ea-2c64-42b1-923b-b9adb8026f75 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 404 len: 111 microversion: 2.1 time: 0.065798 Jun 15 15:01:32.232405 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 477/957] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:32 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:32.241980 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-99407d41-ebde-42c7-8aec-9012af1555b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '.version_select at 0x7fb8a851df70>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:32.370284 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:32.371303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:32.380345 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.381342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:32.383413 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.384380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:32.389338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-99407d41-ebde-42c7-8aec-9012af1555b1 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-380515949" status: 202 len: 0 microversion: 2.1 time: 0.151388 Jun 15 15:01:32.392674 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 481/958] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Jun 15 15:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-380515949 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:01:32.763426 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:32.774664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:32.783930 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:32.785719 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:32.787121 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ae068740-aa79-4057-8fa3-2ed76aa79a17 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.420730 Jun 15 15:01:32.787836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 478/959] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:32 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:33.805957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:33.807331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:33.815422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:33.816255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:33.817280 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:33.817932 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:34.054251 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:34.063780 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:34.066632 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:34.066632 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4d828297-bef5-4430-84d7-c8e47d652ab6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.264137 Jun 15 15:01:34.066879 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 482/960] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:33 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:35.085291 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:35.086104 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:35.098494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:35.099271 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:35.100203 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:35.101014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:35.247616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:35.257863 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:35.259973 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:35.266933 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-34da28e1-be34-4294-b58e-c7341f8703e7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.181156 Jun 15 15:01:35.268253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 479/961] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:35 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:36.287082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:36.287705 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:36.295363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.295825 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.296657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.297180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.409379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:36.410691 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:36.425713 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.426393 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.427349 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.427802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.443802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] HTTP exception thrown: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Request method failure captured: Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 HTTP/1.1 Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGqrgGokbV2c9gtSCqVCRsKr0d_vzUe0Lj7ZuxV26CeHtGfo2bpR7uz5BdE_f_AJXO4vbVVG_l2eQ9IG6StwlG_BOYoHQPE9V3GNSyoJ_mUpOkMCp8WmcebLNHeJt1mer2Ttqa2616gzyfP-u9VtuuVwNwKPtRoXqiHJzI6pa3FJPY Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:01:36.446045 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 0650eb65117a4e27908c4355bfc46c3b Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.447703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'f44bf928-fd4e-4132-93a4-286add941a90'} Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:36.448677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.450170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.452825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Returning 404 to user: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:36.455067 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0e47fec4-4832-48f8-9b95-6d9601828f9b tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 404 len: 111 microversion: 2.1 time: 0.054573 Jun 15 15:01:36.457043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 480/962] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:36 2022] DELETE /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:36.465707 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:36.466987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: f44bf928-fd4e-4132-93a4-286add941a90] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:36.474261 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.475048 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.476040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.476929 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.486560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:36.495145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] HTTP exception thrown: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Request method failure captured: Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 HTTP/1.1 Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGqrgGokbV2c9gtSCqVCRsKr0d_vzUe0Lj7ZuxV26CeHtGfo2bpR7uz5BdE_f_AJXO4vbVVG_l2eQ9IG6StwlG_BOYoHQPE9V3GNSyoJ_mUpOkMCp8WmcebLNHeJt1mer2Ttqa2616gzyfP-u9VtuuVwNwKPtRoXqiHJzI6pa3FJPY Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:01:36.497075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 0650eb65117a4e27908c4355bfc46c3b Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.498748 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'f44bf928-fd4e-4132-93a4-286add941a90'} Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:36.499901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. Jun 15 15:01:36.502065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:36.503528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:36.504665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Returning 404 to user: Instance f44bf928-fd4e-4132-93a4-286add941a90 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:36.505436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:36.505897 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0e3b6ec8-dff5-4de4-ae1d-eeb5abdb0905 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90" status: 404 len: 111 microversion: 2.1 time: 0.044529 Jun 15 15:01:36.506671 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9264bdec-12ef-4c7d-a843-d45fe52ba12b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.223747 Jun 15 15:01:36.507583 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 481/963] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:36 2022] GET /compute/v2.1/servers/f44bf928-fd4e-4132-93a4-286add941a90 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:01:36.522746 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 483/964] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:36 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:37.528050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:37.530043 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:37.544114 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.544823 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.547559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.547559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.730303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:37.740520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:37.742035 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:37.743444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a075f21c-91cf-489f-8b07-bb24eece427c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.219394 Jun 15 15:01:37.744629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 482/965] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:37 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:37.881950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:37.882689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:37.889812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.890604 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.892268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.893039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.913134 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] HTTP exception thrown: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Request method failure captured: Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf HTTP/1.1 Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfGqrgGokbV2c9gtSCqVCRsKr0d_vzUe0Lj7ZuxV26CeHtGfo2bpR7uz5BdE_f_AJXO4vbVVG_l2eQ9IG6StwlG_BOYoHQPE9V3GNSyoJ_mUpOkMCp8WmcebLNHeJt1mer2Ttqa2616gzyfP-u9VtuuVwNwKPtRoXqiHJzI6pa3FJPY Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:01:37.915918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 0650eb65117a4e27908c4355bfc46c3b Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.917796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '9af1b5d3-7171-4426-b239-bc34951326cf'} Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:37.919203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.920883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.922595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Returning 404 to user: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:37.928049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3e655bde-c334-4fe2-83db-2fd361845c38 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 404 len: 111 microversion: 2.1 time: 0.052236 Jun 15 15:01:37.935857 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 484/966] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:37 2022] DELETE /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:37.943936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:37.944608 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] [instance: 9af1b5d3-7171-4426-b239-bc34951326cf] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:37.952216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.952674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.960609 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.961253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.989604 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] HTTP exception thrown: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Request method failure captured: Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf HTTP/1.1 Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfGqrgGokbV2c9gtSCqVCRsKr0d_vzUe0Lj7ZuxV26CeHtGfo2bpR7uz5BdE_f_AJXO4vbVVG_l2eQ9IG6StwlG_BOYoHQPE9V3GNSyoJ_mUpOkMCp8WmcebLNHeJt1mer2Ttqa2616gzyfP-u9VtuuVwNwKPtRoXqiHJzI6pa3FJPY Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:01:37.991331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_175b90b822a942bd8e04b8ad7d228a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 175b90b822a942bd8e04b8ad7d228a57 Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580381324 Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 0650eb65117a4e27908c4355bfc46c3b Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeTestJSON-580381324-project Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.993163 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '9af1b5d3-7171-4426-b239-bc34951326cf'} Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:37.993994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. Jun 15 15:01:37.995240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:01:37.996412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] Returning 404 to user: Instance 9af1b5d3-7171-4426-b239-bc34951326cf could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:37.996412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a68b4f98-6b5b-43e5-a688-8d4ecec815c4 tempest-AttachVolumeTestJSON-580381324 tempest-AttachVolumeTestJSON-580381324-project] 10.222.0.42 "GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf" status: 404 len: 111 microversion: 2.1 time: 0.053109 Jun 15 15:01:37.996412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 483/967] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:37 2022] GET /compute/v2.1/servers/9af1b5d3-7171-4426-b239-bc34951326cf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:38.765228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:38.767122 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:38.779338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:38.781036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:38.782832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:38.783488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:39.072230 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:39.082003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:39.083715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:39.085241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d4235d3c-852c-427a-ba48-745a4e12363b tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.324633 Jun 15 15:01:39.097356 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 485/968] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:38 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:40.107593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:40.108406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:40.127907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.128402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.129204 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.136392 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.428500 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:40.438579 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:40.440181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:40.440835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-af543921-fd83-435c-b19a-84a8e4f0d489 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.339469 Jun 15 15:01:40.441675 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 484/969] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:40 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:41.463720 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:41.464383 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:41.466735 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:41.473933 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:41.474390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:41.475410 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:41.475892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:41.628711 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:41.638038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:41.639946 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:41.642062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a3184939-6958-4205-be52-e64b2b68c932 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.183033 Jun 15 15:01:41.644125 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 486/970] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:41 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:42.660526 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:42.661260 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:42.668906 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:42.669363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:42.670603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:42.671071 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:42.812250 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:42.821900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:42.825617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:42.825617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2e5353e5-dd3e-472e-9e96-3a20cc5e563c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.168303 Jun 15 15:01:42.825617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 485/971] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:42 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:43.842810 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:43.843424 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:43.851056 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:43.851441 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:43.851943 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:43.852417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:43.999375 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:44.011077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:44.012989 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:44.014262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b40c2432-2bd0-4c41-a3fd-e1d53f547102 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.175309 Jun 15 15:01:44.014831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 487/972] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:43 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:45.033833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:45.034494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:45.041229 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:45.041691 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:45.042509 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:45.042951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:45.190252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:45.198865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:45.200409 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:45.201617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-14d7c498-38cd-4d34-baa0-13021f3470df tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.172622 Jun 15 15:01:45.202184 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 486/973] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:45 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:46.219990 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:46.220631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:46.228270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:46.228716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:46.229479 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:46.229913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:46.372767 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:46.381443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:46.382957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:46.384148 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4c54a82f-41bf-467e-9ef0-44110939b7f4 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.168113 Jun 15 15:01:46.384703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 488/974] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:46 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:47.275386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4f58aa39-cb0c-4ff8-a140-8a536708f788 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8a8f27550>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:47.322914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4f58aa39-cb0c-4ff8-a140-8a536708f788 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/047cffb1-765b-4c37-82ff-1cd8034b6454" status: 200 len: 351 microversion: 2.1 time: 0.051271 Jun 15 15:01:47.323487 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 487/975] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 15:01:47 2022] GET /compute/v2.1/os-volumes/047cffb1-765b-4c37-82ff-1cd8034b6454 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:47.402561 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:47.403172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:47.409875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.410323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.411095 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.411524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.548920 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:47.564541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:47.566256 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:47.567630 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cc0a3c27-dbbf-40ee-9879-59aada36c3fa tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.169052 Jun 15 15:01:47.568208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 489/976] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:47 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:48.587144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:48.587820 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:48.600488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:48.600940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:48.601740 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:48.602179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:48.736708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:48.745524 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:48.747037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:48.748326 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3100c408-bf8b-4dbe-bd95-505c21acee7e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.165678 Jun 15 15:01:48.748890 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 488/977] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:48 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:49.766646 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:49.767253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:49.773874 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.774317 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.775087 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.775514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.905471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:49.914592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:49.916162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:49.917343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8d2c2bc9-2ada-455c-bbf1-2574c6d64f7a tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.154575 Jun 15 15:01:49.917900 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 490/978] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:49 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:50.072065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0e01a489-2c05-4539-adff-6af571fc4d2d tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8a8f598b0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:50.120760 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0e01a489-2c05-4539-adff-6af571fc4d2d tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9d16fd49-cd6a-45e4-aab2-15e554177160" status: 200 len: 350 microversion: 2.1 time: 0.052463 Jun 15 15:01:50.121354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 489/979] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 15:01:50 2022] GET /compute/v2.1/os-volumes/9d16fd49-cd6a-45e4-aab2-15e554177160 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:50.936522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:50.937130 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:50.945151 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:50.945644 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:50.951525 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:50.951525 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:51.083912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:51.092421 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:51.093936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:51.095128 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-eb5bb641-8518-4f90-abb9-7344ba2280c1 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.162826 Jun 15 15:01:51.095706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 491/980] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:50 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:52.115208 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:52.115813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:52.122925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.123504 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.124701 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.125018 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.259801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:52.268226 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:52.269826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:52.271418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8ae2e051-b4fa-4f17-a2d5-c870caf12391 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.161585 Jun 15 15:01:52.271888 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 490/981] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:52 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:52.510883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-dc3f959c-fb5c-4a7f-9144-be6eaadba660 req-25be6352-3eec-4b2f-a66a-f43b6199f81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb410306-baba-4584-9def-e17d53db3ce4", "name": "network-vif-plugged", "status": "completed", "tag": "64b622a1-14da-45ed-a6c9-adcf5f16d5aa"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:52.518808 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dc3f959c-fb5c-4a7f-9144-be6eaadba660 req-25be6352-3eec-4b2f-a66a-f43b6199f81e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.519250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-dc3f959c-fb5c-4a7f-9144-be6eaadba660 req-25be6352-3eec-4b2f-a66a-f43b6199f81e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.530940 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-dc3f959c-fb5c-4a7f-9144-be6eaadba660 req-25be6352-3eec-4b2f-a66a-f43b6199f81e service nova] Creating event network-vif-plugged:64b622a1-14da-45ed-a6c9-adcf5f16d5aa for instance bb410306-baba-4584-9def-e17d53db3ce4 on hv-cinder-78729 Jun 15 15:01:52.536329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-dc3f959c-fb5c-4a7f-9144-be6eaadba660 req-25be6352-3eec-4b2f-a66a-f43b6199f81e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153318 Jun 15 15:01:52.537045 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 492/982] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:52.809295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-19875822-dc69-40d5-ad91-c1bae0364e50 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8a8dd6c10>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:52.856860 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-19875822-dc69-40d5-ad91-c1bae0364e50 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6772ec44-8f6f-4283-9c42-afd33c8e11cd" status: 200 len: 351 microversion: 2.1 time: 0.051435 Jun 15 15:01:52.857465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 491/983] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 15:01:52 2022] GET /compute/v2.1/os-volumes/6772ec44-8f6f-4283-9c42-afd33c8e11cd => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:52.870294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-104f1846-2fe8-44e6-8af2-c2ef6cd5583a tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8acc28dc0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:52.956348 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-104f1846-2fe8-44e6-8af2-c2ef6cd5583a tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090335 Jun 15 15:01:52.956938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 493/984] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Jun 15 15:01:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:52.970249 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9171b7ce-ae56-42e9-b93f-f487e4709dbb tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8a84ab1f0>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.053403 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9171b7ce-ae56-42e9-b93f-f487e4709dbb tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087168 Jun 15 15:01:53.054004 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 492/985] 10.222.0.42 () {58 vars in 1148 bytes} [Wed Jun 15 15:01:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:53.065665 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-593b7c16-e234-41af-ad6c-60865cb2230c tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8a856bdc0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.148866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-593b7c16-e234-41af-ad6c-60865cb2230c tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086910 Jun 15 15:01:53.149428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 494/986] 10.222.0.42 () {58 vars in 1133 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:53.161750 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c850c086-de6b-41f3-b3dc-cbfd05fad58f tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8a82d5280>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.244004 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c850c086-de6b-41f3-b3dc-cbfd05fad58f tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087198 Jun 15 15:01:53.244620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 493/987] 10.222.0.42 () {58 vars in 1166 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:53.257396 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ebcb2c78-8567-4f23-a1c9-cffe05eb9504 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8accbd940>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.289962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.290576 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:53.296969 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:53.297371 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.298225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:53.298666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.345576 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ebcb2c78-8567-4f23-a1c9-cffe05eb9504 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092118 Jun 15 15:01:53.346304 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 495/988] 10.222.0.42 () {58 vars in 1169 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:53.359219 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bc123cc3-a383-4d66-b499-04aad7dbefbb tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8acc9f040>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.437853 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:53.441171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bc123cc3-a383-4d66-b499-04aad7dbefbb tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085654 Jun 15 15:01:53.442378 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 496/989] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:53.448945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:53.450634 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:53.452025 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7382a28c-5ea0-44a5-888d-4b6ade53a232 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.166586 Jun 15 15:01:53.452839 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 494/990] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:53.453481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bda71cd8-23ec-4f1a-b234-042acd3f6d0c tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8acc28dc0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.534926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bda71cd8-23ec-4f1a-b234-042acd3f6d0c tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085175 Jun 15 15:01:53.535878 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 497/991] 10.222.0.42 () {58 vars in 1187 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:53.547268 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a97fe0fd-260d-4ef1-97ff-cbebbfe70ca8 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] Calling method '.version_select at 0x7fb8a8f6b310>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.631768 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a97fe0fd-260d-4ef1-97ff-cbebbfe70ca8 tempest-VolumesTestJSON-1568182706 tempest-VolumesTestJSON-1568182706-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087159 Jun 15 15:01:53.631768 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 495/992] 10.222.0.42 () {58 vars in 1154 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:54.471375 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:54.476269 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:54.479673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:54.480174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:54.480943 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:54.481376 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:54.616991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:54.625468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:54.627161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:54.628404 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d5f293c8-788b-4301-8929-7dc15d2d5e08 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.161511 Jun 15 15:01:54.628976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 498/993] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:54 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:55.647753 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:55.650331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:55.655660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:55.656215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.656986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:55.657422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.796378 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:55.804727 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:55.806266 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:55.807428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0833f535-c919-4e79-b68a-fd430efe1c29 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1732 microversion: 2.20 time: 0.165426 Jun 15 15:01:55.807985 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 496/994] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:55 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:56.826040 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:56.826656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:56.834319 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.834528 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.835192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.835628 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:57.233159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:57.241447 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:57.242984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:57.244834 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-403eb923-79a3-499d-951e-6ef937e435b7 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1719 microversion: 2.20 time: 0.422821 Jun 15 15:01:57.245399 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 499/995] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:56 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1719 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:00.043199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-766f6aec-06b0-48be-a1d5-06d69950d438 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Action: 'create', calling method: .version_select at 0x7fb8a82e4670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1701667030", "metadata": {"Type": "work"}}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-766f6aec-06b0-48be-a1d5-06d69950d438 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Request method failure captured: Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 122 Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfRnQ1sI3p2RAm5qy5AFIKMV94LSbp9MKV4DW-IgV1N8h3vGOuhvTcIngcas5EJLeZ9gYGif3azd1w2v4hPuChlC-MBqRhbQEnr3hLZhaOhAwxF_EOGnjVczbgR_ALs-HjWdlmHF40-ux4cmpg2NtfE0QmOe33ShWmL07g1O_tk1u4M Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:02:00.069179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 54d1fa49c0da487298898008a4b5afe7 Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1701667030", "metadata": {"Type": "work"}}} Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: Jun 15 15:02:00.071015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1701667030', 'metadata': {'Type': 'work'}}}} Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise error Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:00.071889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 15:02:00.073645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 15:02:00.075269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 15:02:00.075269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.075269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-766f6aec-06b0-48be-a1d5-06d69950d438 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:00.075269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-766f6aec-06b0-48be-a1d5-06d69950d438 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147765 Jun 15 15:02:00.075269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 497/996] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jun 15 15:01:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 15:02:00.081338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4c7723a-e0fb-4fd0-b169-b2369628a1e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Action: 'create', calling method: .version_select at 0x7fb8a851d790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-30101777", "metadata": {"Type": "work"}}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4c7723a-e0fb-4fd0-b169-b2369628a1e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Request method failure captured: Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 118 Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfRnQ1sI3p2RAm5qy5AFIKMV94LSbp9MKV4DW-IgV1N8h3vGOuhvTcIngcas5EJLeZ9gYGif3azd1w2v4hPuChlC-MBqRhbQEnr3hLZhaOhAwxF_EOGnjVczbgR_ALs-HjWdlmHF40-ux4cmpg2NtfE0QmOe33ShWmL07g1O_tk1u4M Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:02:00.084887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 54d1fa49c0da487298898008a4b5afe7 Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-30101777", "metadata": {"Type": "work"}}} Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: Jun 15 15:02:00.086515 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-30101777', 'metadata': {'Type': 'work'}}}} Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise error Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi '0' Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:00.087500 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 15:02:00.089284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 15:02:00.090690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 15:02:00.090690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.090690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4c7723a-e0fb-4fd0-b169-b2369628a1e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:00.090690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b4c7723a-e0fb-4fd0-b169-b2369628a1e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008974 Jun 15 15:02:00.090690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 500/997] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jun 15 15:02:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:02:00.095955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-26b01eef-9464-42db-94cf-6f03baaea641 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Action: 'create', calling method: .version_select at 0x7fb8a8d78b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1503696997", "metadata": {"Type": "work"}}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-26b01eef-9464-42db-94cf-6f03baaea641 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Request method failure captured: Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 119 Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfRnQ1sI3p2RAm5qy5AFIKMV94LSbp9MKV4DW-IgV1N8h3vGOuhvTcIngcas5EJLeZ9gYGif3azd1w2v4hPuChlC-MBqRhbQEnr3hLZhaOhAwxF_EOGnjVczbgR_ALs-HjWdlmHF40-ux4cmpg2NtfE0QmOe33ShWmL07g1O_tk1u4M Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:02:00.098353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 54d1fa49c0da487298898008a4b5afe7 Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1503696997", "metadata": {"Type": "work"}}} Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: Jun 15 15:02:00.099939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1503696997', 'metadata': {'Type': 'work'}}}} Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise error Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi '' Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:00.101160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 15:02:00.103422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 15:02:00.113587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 15:02:00.113587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.113587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-26b01eef-9464-42db-94cf-6f03baaea641 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:00.113587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-26b01eef-9464-42db-94cf-6f03baaea641 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007783 Jun 15 15:02:00.113587 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 498/998] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Jun 15 15:02:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:02:00.114676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-948cc12f-7043-4d07-a541-f5c3e3d05c56 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Calling method '.version_select at 0x7fb8acc28dc0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:00.147769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-948cc12f-7043-4d07-a541-f5c3e3d05c56 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] HTTP exception thrown: Volume tempest-invalid-915637936 could not be found. Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-948cc12f-7043-4d07-a541-f5c3e3d05c56 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Request method failure captured: Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-915637936 HTTP/1.1 Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfRnQ1sI3p2RAm5qy5AFIKMV94LSbp9MKV4DW-IgV1N8h3vGOuhvTcIngcas5EJLeZ9gYGif3azd1w2v4hPuChlC-MBqRhbQEnr3hLZhaOhAwxF_EOGnjVczbgR_ALs-HjWdlmHF40-ux4cmpg2NtfE0QmOe33ShWmL07g1O_tk1u4M Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:02:00.149977 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 54d1fa49c0da487298898008a4b5afe7 Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Volume tempest-invalid-915637936 could not be found. Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'tempest-invalid-915637936'} Jun 15 15:02:00.151745 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-915637936 could not be found. (HTTP 404) (Request-ID: req-78d8b70b-9b23-4571-8f17-a3884e6be1d8) Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.152783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:02:00.154342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-915637936 could not be found. Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:00.155792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-915637936 could not be found. Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-915637936 could not be found. Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-948cc12f-7043-4d07-a541-f5c3e3d05c56 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Returning 404 to user: Volume tempest-invalid-915637936 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-948cc12f-7043-4d07-a541-f5c3e3d05c56 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-915637936" status: 404 len: 98 microversion: 2.1 time: 0.045771 Jun 15 15:02:00.157386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 501/999] 10.222.0.42 () {58 vars in 1214 bytes} [Wed Jun 15 15:02:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-915637936 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 15 15:02:00.164776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a5bdb49a-25e5-4687-9f21-300d64cea7c4 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007571 Jun 15 15:02:00.165293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 499/1000] 10.222.0.42 () {58 vars in 1139 bytes} [Wed Jun 15 15:02:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 15:02:00.174205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-91aecb3d-2b48-4f60-a009-acfda5c8d630 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003787 Jun 15 15:02:00.174788 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 502/1001] 10.222.0.42 () {58 vars in 1136 bytes} [Wed Jun 15 15:02:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 15:02:00.189842 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f12ce3a9-bccb-4dd8-9c12-07a56f9bf2e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Calling method '.version_select at 0x7fb8a8dcdd30>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:00.231853 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-f12ce3a9-bccb-4dd8-9c12-07a56f9bf2e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] HTTP exception thrown: Volume cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 could not be found. Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f12ce3a9-bccb-4dd8-9c12-07a56f9bf2e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Request method failure captured: Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: DELETE /compute/v2.1/os-volumes/cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 HTTP/1.1 Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfRnQ1sI3p2RAm5qy5AFIKMV94LSbp9MKV4DW-IgV1N8h3vGOuhvTcIngcas5EJLeZ9gYGif3azd1w2v4hPuChlC-MBqRhbQEnr3hLZhaOhAwxF_EOGnjVczbgR_ALs-HjWdlmHF40-ux4cmpg2NtfE0QmOe33ShWmL07g1O_tk1u4M Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:02:00.233869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 54d1fa49c0da487298898008a4b5afe7 Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Volume cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 could not be found. Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'cb493a2d-10e4-4ea2-8bca-0126bb7b6f97'} Jun 15 15:02:00.235473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 could not be found. (HTTP 404) (Request-ID: req-c355de34-c33d-4fa0-907f-59048db86083) Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.236454 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:02:00.237656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 could not be found. Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 15:02:00.239373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 could not be found. Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 could not be found. Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f12ce3a9-bccb-4dd8-9c12-07a56f9bf2e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Returning 404 to user: Volume cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f12ce3a9-bccb-4dd8-9c12-07a56f9bf2e1 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/cb493a2d-10e4-4ea2-8bca-0126bb7b6f97" status: 404 len: 109 microversion: 2.1 time: 0.053548 Jun 15 15:02:00.240613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 500/1002] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 15:02:00 2022] DELETE /compute/v2.1/os-volumes/cb493a2d-10e4-4ea2-8bca-0126bb7b6f97 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:00.256306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aa363f06-2cc5-4eff-a8e1-d1f41182cd77 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Calling method '.version_select at 0x7fb8a851d430>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:00.284001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-aa363f06-2cc5-4eff-a8e1-d1f41182cd77 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] HTTP exception thrown: Volume a431d4df-9a42-493d-bf12-c05df89c068f could not be found. Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aa363f06-2cc5-4eff-a8e1-d1f41182cd77 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Request method failure captured: Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/os-volumes/a431d4df-9a42-493d-bf12-c05df89c068f HTTP/1.1 Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfRnQ1sI3p2RAm5qy5AFIKMV94LSbp9MKV4DW-IgV1N8h3vGOuhvTcIngcas5EJLeZ9gYGif3azd1w2v4hPuChlC-MBqRhbQEnr3hLZhaOhAwxF_EOGnjVczbgR_ALs-HjWdlmHF40-ux4cmpg2NtfE0QmOe33ShWmL07g1O_tk1u4M Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:02:00.286783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2aeecf8eb64346e68a4038d37e1f0f2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 2aeecf8eb64346e68a4038d37e1f0f2b Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesNegativeTest-107868137 Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 54d1fa49c0da487298898008a4b5afe7 Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesNegativeTest-107868137-project Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Volume a431d4df-9a42-493d-bf12-c05df89c068f could not be found. Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'a431d4df-9a42-493d-bf12-c05df89c068f'} Jun 15 15:02:00.288689 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a431d4df-9a42-493d-bf12-c05df89c068f could not be found. (HTTP 404) (Request-ID: req-f893eeb4-6e9e-4ddd-8d35-14dbf42ae341) Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.289880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:00.291279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a431d4df-9a42-493d-bf12-c05df89c068f could not be found. Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 15:02:00.292887 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a431d4df-9a42-493d-bf12-c05df89c068f could not be found. Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a431d4df-9a42-493d-bf12-c05df89c068f could not be found. Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aa363f06-2cc5-4eff-a8e1-d1f41182cd77 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] Returning 404 to user: Volume a431d4df-9a42-493d-bf12-c05df89c068f could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aa363f06-2cc5-4eff-a8e1-d1f41182cd77 tempest-VolumesNegativeTest-107868137 tempest-VolumesNegativeTest-107868137-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a431d4df-9a42-493d-bf12-c05df89c068f" status: 404 len: 109 microversion: 2.1 time: 0.036426 Jun 15 15:02:00.294401 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 503/1003] 10.222.0.42 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:00 2022] GET /compute/v2.1/os-volumes/a431d4df-9a42-493d-bf12-c05df89c068f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:01.366354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-108099186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-993253485", "security_groups": [{"name": "tempest-secgroup-smoke-693886938"}], "block_device_mapping_v2": [{"uuid": "a86fb604-dea9-4f2f-ae2a-45592d68c472", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae29f25b-1566-4281-8605-e2a4f3901460"}]}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:01.375994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=46 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:01.482580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] validate_networks() for [('ae29f25b-1566-4281-8605-e2a4f3901460', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:02:01.928394 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:02:01.928988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:02:01.929638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:02:01.930448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:02:01.931269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:02:01.942790 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:01.943203 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:01.944862 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:01.945804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:01.963621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:02:01.969169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for user e209ae2f7fa7412b95c7c43c74c14426 and project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:02:02.028879 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:02:02.031023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a86fb604-dea9-4f2f-ae2a-45592d68c472',volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:02:02.471885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a755983-7e7a-41fc-b6f9-93e3de2e897c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.110608 Jun 15 15:02:02.473424 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 501/1004] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:02:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:02:02.484885 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-149dfbd0-ec43-4ece-914d-dbe498d4617a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:02.486068 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-149dfbd0-ec43-4ece-914d-dbe498d4617a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:02.487757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:02.552224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-149dfbd0-ec43-4ece-914d-dbe498d4617a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:02.561020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-149dfbd0-ec43-4ece-914d-dbe498d4617a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1093 microversion: 2.1 time: 0.081316 Jun 15 15:02:02.561764 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 504/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:02 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:03.578908 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-794e6fff-bc24-494a-84e0-cf96b66f1373 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:03.579636 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-794e6fff-bc24-494a-84e0-cf96b66f1373 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:03.647849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-794e6fff-bc24-494a-84e0-cf96b66f1373 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:03.652872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-794e6fff-bc24-494a-84e0-cf96b66f1373 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1093 microversion: 2.1 time: 0.078640 Jun 15 15:02:03.653447 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 502/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:03 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:04.671026 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:04.671672 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:04.683468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:04.683468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:04.683468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:04.683468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:04.683999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:04.745588 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:04.753621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7f795ba4-0eeb-4cd1-b61b-d8ab145c5178 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1191 microversion: 2.1 time: 0.086868 Jun 15 15:02:04.754192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 505/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:04 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:05.774899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:05.775682 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:05.783248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:05.783787 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:05.784679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:05.785123 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:05.856442 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:05.863990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a7ac4133-40a4-4bb9-bb82-d8485d443180 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1209 microversion: 2.1 time: 0.095467 Jun 15 15:02:05.864688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 503/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:05 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:06.885991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:06.886627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:06.894837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:06.895296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:06.896326 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:06.896960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:07.102019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:07.110510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-dca8662b-bdf9-4e9d-9d0e-b1f360b846cf tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1276 microversion: 2.1 time: 0.232961 Jun 15 15:02:07.111086 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 506/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:06 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:07.286833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-cfed4452-eec6-49b0-ba5c-18ac203b5bc3 req-4ca1c1ea-26a8-47b5-83c8-236f1c284a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4fc143-9763-4dfc-94c5-2cddc7e27c0e", "tag": "f35a17de-d34b-452e-8f02-ea62fa068cb1"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:07.296204 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-cfed4452-eec6-49b0-ba5c-18ac203b5bc3 req-4ca1c1ea-26a8-47b5-83c8-236f1c284a6a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:07.296917 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-cfed4452-eec6-49b0-ba5c-18ac203b5bc3 req-4ca1c1ea-26a8-47b5-83c8-236f1c284a6a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:07.299869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=70 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:07.311286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-cfed4452-eec6-49b0-ba5c-18ac203b5bc3 req-4ca1c1ea-26a8-47b5-83c8-236f1c284a6a service nova] Creating event network-changed:f35a17de-d34b-452e-8f02-ea62fa068cb1 for instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e on hv-cinder-78729 Jun 15 15:02:07.316623 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-cfed4452-eec6-49b0-ba5c-18ac203b5bc3 req-4ca1c1ea-26a8-47b5-83c8-236f1c284a6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035017 Jun 15 15:02:07.317243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 504/1010] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:08.129464 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:08.130113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:08.136969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:08.137483 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:08.138264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:08.138719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:08.311195 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:08.319565 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-30daad6f-e76c-486e-90ad-98f1fdee23c1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.194532 Jun 15 15:02:08.320174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 507/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:08 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:09.338415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:09.339157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:09.346212 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:09.346666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:09.347491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:09.347924 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:09.481305 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:09.488836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b10e6016-dd32-4120-8894-d3f780ff019a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.155833 Jun 15 15:02:09.489404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 505/1012] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:09 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:10.505932 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:10.506637 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:10.513097 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:10.513554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:10.514323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:10.514766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:10.646101 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:10.654159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-41aba977-a307-46a7-8e14-4c19be7c978e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.152721 Jun 15 15:02:10.657904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 508/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:10 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:11.672023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:11.672703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:11.680197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:11.680647 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:11.681423 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:11.681859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:11.819452 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:11.830090 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fa749fbc-0c97-4676-bbbb-04a2e51d809b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.161855 Jun 15 15:02:11.830663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 506/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:11 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:12.851312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:12.851940 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:12.854141 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:12.859093 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:12.864033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:12.864033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:12.864033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:12.993873 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:13.001680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-400f7fbf-bd8c-4279-b03a-073cd6bd7307 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.155051 Jun 15 15:02:13.002257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 509/1015] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:12 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:14.018181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:14.018796 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:14.020933 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:14.025581 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=8 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:14.027741 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.028233 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.029009 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.029450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.172743 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:14.181570 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-de9c647b-0c64-4d13-8cd6-459f40b2dc70 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.167095 Jun 15 15:02:14.186089 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 507/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:14 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:15.201487 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:15.202098 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:15.209744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:15.210469 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:15.211363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:15.211812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:15.347058 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:15.355272 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-39ad2de7-4630-439a-a953-cd8477586fd8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.158249 Jun 15 15:02:15.356139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 510/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:15 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:16.373851 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:16.375655 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:16.384997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:16.385813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:16.387272 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:16.388131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:16.542060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:16.553193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7df900aa-4721-4ca1-9159-e86992ef7c2a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.184009 Jun 15 15:02:16.560153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 508/1018] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:16 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:17.571294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:17.571935 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:17.578445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:17.578973 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:17.579738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:17.580256 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:17.716754 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:17.724394 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-57accc56-4277-4cb1-9b3c-3944151a0c0b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.157290 Jun 15 15:02:17.725569 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 511/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:17 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:18.657685 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-12256f3c-1dca-4843-af2e-1e8d5e6ebfc3 req-aac7ab49-7141-48be-898c-4d132c7dccdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4fc143-9763-4dfc-94c5-2cddc7e27c0e", "name": "network-vif-plugged", "status": "completed", "tag": "f35a17de-d34b-452e-8f02-ea62fa068cb1"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:18.667084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-12256f3c-1dca-4843-af2e-1e8d5e6ebfc3 req-aac7ab49-7141-48be-898c-4d132c7dccdc service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.667559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-12256f3c-1dca-4843-af2e-1e8d5e6ebfc3 req-aac7ab49-7141-48be-898c-4d132c7dccdc service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.680646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-12256f3c-1dca-4843-af2e-1e8d5e6ebfc3 req-aac7ab49-7141-48be-898c-4d132c7dccdc service nova] Creating event network-vif-plugged:f35a17de-d34b-452e-8f02-ea62fa068cb1 for instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e on hv-cinder-78729 Jun 15 15:02:18.685863 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-12256f3c-1dca-4843-af2e-1e8d5e6ebfc3 req-aac7ab49-7141-48be-898c-4d132c7dccdc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032284 Jun 15 15:02:18.689758 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 509/1020] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:18.743320 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:18.746448 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:18.757214 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.759338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.764627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.764627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.904710 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:18.914939 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7fea0b9c-f88d-4190-89bb-34a6b71cee7d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.176705 Jun 15 15:02:18.915549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 512/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:18 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:19.939952 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:19.940697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:19.947656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:19.948134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:19.948914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:19.949358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:20.124286 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:20.131811 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-87f3ddeb-749d-4dc9-b891-429a4c00d86c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.196652 Jun 15 15:02:20.132978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 510/1022] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:19 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:21.149089 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:21.149631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:21.156920 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:21.157397 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:21.158183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:21.158653 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:21.296370 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:21.303915 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-aa5f21f5-1777-45a6-aab4-bb1dc0f2498a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1264 microversion: 2.1 time: 0.159161 Jun 15 15:02:21.305261 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 513/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:21 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:22.322316 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:22.323127 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:22.329848 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.330303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.331112 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.331580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.485068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:22.495209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3a71070a-c9f4-46d5-85f1-a85751f27098 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1450 microversion: 2.1 time: 0.175711 Jun 15 15:02:22.495209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 511/1024] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:22 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:22.510624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:22.511242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:22.517706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.518174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.518995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.519428 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.671069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:22.678795 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cf07cc7f-3f71-4c2b-8dfa-131d58c943fa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1450 microversion: 2.1 time: 0.172837 Jun 15 15:02:22.680025 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 514/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:22 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:25.016957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-47f7e54b-66f8-4977-82c5-b50e8749fd96 req-6036f5bc-4710-4bfe-abca-9cc96fbe4d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4fc143-9763-4dfc-94c5-2cddc7e27c0e", "tag": "f35a17de-d34b-452e-8f02-ea62fa068cb1"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:25.025872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-47f7e54b-66f8-4977-82c5-b50e8749fd96 req-6036f5bc-4710-4bfe-abca-9cc96fbe4d67 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:25.026317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-47f7e54b-66f8-4977-82c5-b50e8749fd96 req-6036f5bc-4710-4bfe-abca-9cc96fbe4d67 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:25.038157 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-47f7e54b-66f8-4977-82c5-b50e8749fd96 req-6036f5bc-4710-4bfe-abca-9cc96fbe4d67 service nova] Creating event network-changed:f35a17de-d34b-452e-8f02-ea62fa068cb1 for instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e on hv-cinder-78729 Jun 15 15:02:25.044217 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-47f7e54b-66f8-4977-82c5-b50e8749fd96 req-6036f5bc-4710-4bfe-abca-9cc96fbe4d67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030869 Jun 15 15:02:25.044769 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 512/1026] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:05.938793 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8fce2e20-f67c-406d-aaa6-6b460bd853be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:05.939827 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8fce2e20-f67c-406d-aaa6-6b460bd853be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:05.942078 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=23 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:05.942723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=59 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:05.947415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8fce2e20-f67c-406d-aaa6-6b460bd853be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:05.947881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8fce2e20-f67c-406d-aaa6-6b460bd853be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:05.948798 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8fce2e20-f67c-406d-aaa6-6b460bd853be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:05.949238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8fce2e20-f67c-406d-aaa6-6b460bd853be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:05.977607 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8fce2e20-f67c-406d-aaa6-6b460bd853be tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042753 Jun 15 15:03:05.978273 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 515/1027] 10.222.0.42 () {60 vars in 1342 bytes} [Wed Jun 15 15:03:05 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:06.040354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:06.041295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=41 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:06.045775 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:06.046394 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:06.052571 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:06.053025 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:06.053814 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:06.054303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:06.080011 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Going to try to terminate instance {{(pid=124660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:03:06.360705 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8966ace8-a9e1-4a42-bdec-bb23d2304d36 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 204 len: 0 microversion: 2.20 time: 0.321711 Jun 15 15:03:06.361295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 513/1028] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jun 15 15:03:06 2022] DELETE /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 15:03:06.370157 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:06.370831 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:06.377516 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:06.377968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:06.378737 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:06.379172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:06.507690 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:06.516516 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:06.518032 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:06.519200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8368a494-9a5a-4ecd-9507-bf9a05158545 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.153594 Jun 15 15:03:06.519789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 516/1029] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:06 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:07.231093 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:03:07.231093 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 15:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:03:07.538178 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:07.538889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:07.545577 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:07.546039 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:07.546851 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:07.547294 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:07.678786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:07.686749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:07.688307 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:07.689467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-315103cc-fe2b-47ac-a516-21622e1a5400 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.155642 Jun 15 15:03:07.690027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 514/1030] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:07 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:08.708367 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:08.708913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:08.715994 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:08.716471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:08.717253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:08.717710 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:08.915908 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:08.925356 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:08.926871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:08.928079 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-67aa71d7-4100-46e2-b916-f3254be88352 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1725 microversion: 2.20 time: 0.223810 Jun 15 15:03:08.928673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 517/1031] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:08 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:09.325462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-b4b30368-0b0b-47a6-9d96-10ac10e5a508 req-d77e0c2d-3352-404e-ae15-e759bee9a98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb410306-baba-4584-9def-e17d53db3ce4", "name": "network-vif-deleted", "tag": "64b622a1-14da-45ed-a6c9-adcf5f16d5aa"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:09.334660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-b4b30368-0b0b-47a6-9d96-10ac10e5a508 req-d77e0c2d-3352-404e-ae15-e759bee9a98a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:09.336242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-b4b30368-0b0b-47a6-9d96-10ac10e5a508 req-d77e0c2d-3352-404e-ae15-e759bee9a98a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:09.350074 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-b4b30368-0b0b-47a6-9d96-10ac10e5a508 req-d77e0c2d-3352-404e-ae15-e759bee9a98a service nova] Creating event network-vif-deleted:64b622a1-14da-45ed-a6c9-adcf5f16d5aa for instance bb410306-baba-4584-9def-e17d53db3ce4 on hv-cinder-78729 Jun 15 15:03:09.356254 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-b4b30368-0b0b-47a6-9d96-10ac10e5a508 req-d77e0c2d-3352-404e-ae15-e759bee9a98a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035231 Jun 15 15:03:09.357078 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 515/1032] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:09.947381 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:09.947940 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:09.955050 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:09.955499 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:09.956342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:09.956769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:10.002274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:10.002725 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:10.003174 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lazy-loading 'fault' on Instance uuid bb410306-baba-4584-9def-e17d53db3ce4 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:03:10.047600 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:10.055917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:10.057459 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcc02eb960e45b99587438aa3696f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c28220b6ea4db99f81a37e0794450b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:10.059192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7890f5ba-fc4c-4c03-b6ba-96998ca5711d tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 200 len: 1372 microversion: 2.20 time: 0.115832 Jun 15 15:03:10.059760 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 518/1033] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:09 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:11.085667 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:11.086390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:11.093667 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:11.094172 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:11.094998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:11.095489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:11.109755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] HTTP exception thrown: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Request method failure captured: Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 HTTP/1.1 Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfIpuwCOEV1p06_tr2itxtCl5afRcUPMoieiLU8Gq_0YgL3G6IsdjX69qw_aWoZuYWEIO1MGJp1elBBGBk28WY9gRH59P2YCkuJJ_LaGdexy0imuciHCBJM7RqBmurcjl_Saq4bfHaxdPopdcuJR2v9xG-fQw-PWdVennHn2Fyvl4uE Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:03:11.111444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 2dcc02eb960e45b99587438aa3696f40 Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:11.113313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'bb410306-baba-4584-9def-e17d53db3ce4'} Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:11.114330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:11.115664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:11.117265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Returning 404 to user: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:11.117265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-efa79266-e5bb-44c2-ac0c-80d53221419c tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 404 len: 111 microversion: 2.20 time: 0.032211 Jun 15 15:03:11.117265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 516/1034] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:11 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 15:03:11.122175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-456bf986-9129-4450-a728-a02ab4f369e6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '.version_select at 0x7fb8acc28670>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:11.218726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-456bf986-9129-4450-a728-a02ab4f369e6 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770540482" status: 204 len: 0 microversion: 2.20 time: 0.100424 Jun 15 15:03:11.219316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 519/1035] 10.222.0.42 () {60 vars in 1261 bytes} [Wed Jun 15 15:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770540482 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 15:03:13.296288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:13.296795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:13.303507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:13.303963 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:13.304759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:13.305196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:13.320182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] HTTP exception thrown: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Request method failure captured: Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: DELETE /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 HTTP/1.1 Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfIpuwCOEV1p06_tr2itxtCl5afRcUPMoieiLU8Gq_0YgL3G6IsdjX69qw_aWoZuYWEIO1MGJp1elBBGBk28WY9gRH59P2YCkuJJ_LaGdexy0imuciHCBJM7RqBmurcjl_Saq4bfHaxdPopdcuJR2v9xG-fQw-PWdVennHn2Fyvl4uE Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:03:13.321737 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 2dcc02eb960e45b99587438aa3696f40 Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.323317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'bb410306-baba-4584-9def-e17d53db3ce4'} Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:13.324797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.326290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.327920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Returning 404 to user: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:13.327920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fc6be090-0da4-4fd8-a872-57e6bda1ba61 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 404 len: 111 microversion: 2.20 time: 0.031173 Jun 15 15:03:13.327920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 517/1036] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jun 15 15:03:13 2022] DELETE /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:03:13.333170 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:13.333864 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: bb410306-baba-4584-9def-e17d53db3ce4] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:13.341347 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:13.341875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:13.342804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:13.343400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:13.357654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] HTTP exception thrown: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Request method failure captured: Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 HTTP/1.1 Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfIpuwCOEV1p06_tr2itxtCl5afRcUPMoieiLU8Gq_0YgL3G6IsdjX69qw_aWoZuYWEIO1MGJp1elBBGBk28WY9gRH59P2YCkuJJ_LaGdexy0imuciHCBJM7RqBmurcjl_Saq4bfHaxdPopdcuJR2v9xG-fQw-PWdVennHn2Fyvl4uE Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:03:13.359200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 2dcc02eb960e45b99587438aa3696f40 Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.360967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'bb410306-baba-4584-9def-e17d53db3ce4'} Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:13.361914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. Jun 15 15:03:13.363786 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:13.365156 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Returning 404 to user: Instance bb410306-baba-4584-9def-e17d53db3ce4 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:13.365156 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9adfe9e6-cf77-4d21-8c93-4998e6bd5001 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4" status: 404 len: 111 microversion: 2.20 time: 0.031467 Jun 15 15:03:13.367544 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 520/1037] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:13 2022] GET /compute/v2.1/servers/bb410306-baba-4584-9def-e17d53db3ce4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:03:14.733030 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:14.733599 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:14.739744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:14.741159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:14.741159 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:14.741526 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:14.756812 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] HTTP exception thrown: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Request method failure captured: Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: DELETE /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 HTTP/1.1 Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfIpuwCOEV1p06_tr2itxtCl5afRcUPMoieiLU8Gq_0YgL3G6IsdjX69qw_aWoZuYWEIO1MGJp1elBBGBk28WY9gRH59P2YCkuJJ_LaGdexy0imuciHCBJM7RqBmurcjl_Saq4bfHaxdPopdcuJR2v9xG-fQw-PWdVennHn2Fyvl4uE Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:03:14.758408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 2dcc02eb960e45b99587438aa3696f40 Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.764075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '7cdd536d-6f70-49a7-81e9-5a8d9a874132'} Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:14.765292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.766847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.768491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Returning 404 to user: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:14.768491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4a7be76d-d199-4013-8aec-c2a61af1d26e tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 404 len: 111 microversion: 2.20 time: 0.031873 Jun 15 15:03:14.768491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 518/1038] 10.222.0.42 () {60 vars in 1279 bytes} [Wed Jun 15 15:03:14 2022] DELETE /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:03:14.769811 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:14.770408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] [instance: 7cdd536d-6f70-49a7-81e9-5a8d9a874132] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:14.776908 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:14.777363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:14.778131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:14.778572 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:14.794858 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] HTTP exception thrown: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Request method failure captured: Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 HTTP/1.1 Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfIpuwCOEV1p06_tr2itxtCl5afRcUPMoieiLU8Gq_0YgL3G6IsdjX69qw_aWoZuYWEIO1MGJp1elBBGBk28WY9gRH59P2YCkuJJ_LaGdexy0imuciHCBJM7RqBmurcjl_Saq4bfHaxdPopdcuJR2v9xG-fQw-PWdVennHn2Fyvl4uE Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:03:14.796408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f9c28220b6ea4db99f81a37e0794450b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: f9c28220b6ea4db99f81a37e0794450b Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1578800499 Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 2dcc02eb960e45b99587438aa3696f40 Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1578800499-project Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.798311 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '7cdd536d-6f70-49a7-81e9-5a8d9a874132'} Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:14.799246 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. Jun 15 15:03:14.812457 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:03:14.813938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] Returning 404 to user: Instance 7cdd536d-6f70-49a7-81e9-5a8d9a874132 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:14.813938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9fb60b80-efaf-494f-ac22-c0d19d6da0c8 tempest-AttachVolumeShelveTestJSON-1578800499 tempest-AttachVolumeShelveTestJSON-1578800499-project] 10.222.0.42 "GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132" status: 404 len: 111 microversion: 2.20 time: 0.032090 Jun 15 15:03:14.813938 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 521/1039] 10.222.0.42 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:14 2022] GET /compute/v2.1/servers/7cdd536d-6f70-49a7-81e9-5a8d9a874132 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 15:03:25.441857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:25.442786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:25.620955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d1107fc7-4fc6-4104-8f75-262f9c68e246 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: .version_select at 0x7fb8a83671f0>, body: {"keypair": {"name": "tempest-keypair-655622217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkrwRIenyYvKu4kAJPhpmuNwrVEn8+buQHSMDutM8cOzKxQjrKVijgAVFuRlWS/vjwSZAhZIVRyPajBUmPTJKEtoiIRVT38cr7w8IXh9miZcIjO7wFU4euCdBtBG9DXaQ=="}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:25.636270 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-d1107fc7-4fc6-4104-8f75-262f9c68e246 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:03:25.640765 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-d1107fc7-4fc6-4104-8f75-262f9c68e246 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:03:25.750991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d1107fc7-4fc6-4104-8f75-262f9c68e246 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.314948 Jun 15 15:03:25.751583 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 519/1040] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 15:03:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:28.202268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-155806291", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "115a225d-97b8-4fa4-b2b8-ad448d4e5db3"}], "security_groups": [{"name": "tempest-securitygroup--1027633752"}], "key_name": "tempest-keypair-655622217", "user_data": "}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:28.210865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:28.211776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=30 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:28.339687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] validate_networks() for [('115a225d-97b8-4fa4-b2b8-ad448d4e5db3', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:03:28.841399 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:03:28.841837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:03:28.842880 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:03:28.843574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:03:28.844153 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:03:28.854613 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:28.855067 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:28.855955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:28.856639 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:28.878991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:03:28.884143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:03:28.896867 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:03:28.899257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:03:29.026260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1c187184-193d-4b17-81e3-49856097a0a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.828469 Jun 15 15:03:29.027177 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 522/1041] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:03:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:03:29.038614 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b812bfc0-8886-4e30-934c-c9e31db6c843 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:29.039288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b812bfc0-8886-4e30-934c-c9e31db6c843 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:29.101847 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b812bfc0-8886-4e30-934c-c9e31db6c843 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:29.110092 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b812bfc0-8886-4e30-934c-c9e31db6c843 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1240 microversion: 2.1 time: 0.076334 Jun 15 15:03:29.112335 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 520/1042] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:29 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:30.127437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:30.128103 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:30.134818 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:30.135269 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.136033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:30.136502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.200429 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:30.208890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-561b8cf9-cf20-441a-9ccb-d0fcfb189e66 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1244 microversion: 2.1 time: 0.085945 Jun 15 15:03:30.209462 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 523/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:30 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:31.230072 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:31.231545 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:31.241317 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:31.242060 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:31.243326 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:31.243935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:31.329681 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:31.338182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-089d930b-08c3-4f73-b20f-4adcd36b5d0a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1300 microversion: 2.1 time: 0.115171 Jun 15 15:03:31.338803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 521/1044] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:31 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:32.356962 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:32.358423 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:32.366564 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.367023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.367851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.368323 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.589861 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:32.598282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6e4b5cb4-d17c-4fce-8d74-839b235f9b19 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.245281 Jun 15 15:03:32.598903 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 524/1045] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:32 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:33.041068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-7c22684b-1649-4d1d-bd2a-499721355cb9 req-e36d61eb-9ac1-4887-8e49-f2eabf1a2ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fef7f2a-f9c1-4903-a741-91693d3e88da", "tag": "9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:33.053252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-7c22684b-1649-4d1d-bd2a-499721355cb9 req-e36d61eb-9ac1-4887-8e49-f2eabf1a2ca6 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.054179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-7c22684b-1649-4d1d-bd2a-499721355cb9 req-e36d61eb-9ac1-4887-8e49-f2eabf1a2ca6 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.069583 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-7c22684b-1649-4d1d-bd2a-499721355cb9 req-e36d61eb-9ac1-4887-8e49-f2eabf1a2ca6 service nova] Creating event network-changed:9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde for instance 7fef7f2a-f9c1-4903-a741-91693d3e88da on hv-cinder-78729 Jun 15 15:03:33.075332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-7c22684b-1649-4d1d-bd2a-499721355cb9 req-e36d61eb-9ac1-4887-8e49-f2eabf1a2ca6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038593 Jun 15 15:03:33.075956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 522/1046] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:03:33.615282 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:33.615894 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:33.622682 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.623949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.624785 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.625241 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.842573 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:33.851471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b4cec9b8-43cc-40d9-94f1-5adfc50c393b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.240075 Jun 15 15:03:33.856676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 525/1047] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:33 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:34.870336 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:34.870990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:34.878734 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.879192 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.879975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.880447 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:35.013042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:35.021022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9d8d95d5-fba8-44bc-b029-01409929c562 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.155063 Jun 15 15:03:35.021613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 523/1048] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:34 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:36.038554 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:36.039178 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:36.046023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:36.046482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:36.047264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:36.047709 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:36.180835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:36.188645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-20efd86d-6f25-4533-8a4d-f5aeaa9a2fed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.153851 Jun 15 15:03:36.189236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 526/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:36 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:37.206808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:37.207418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:37.213982 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:37.214472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:37.215240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:37.215681 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:37.355837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:37.363472 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c8b724d3-1bd0-4f53-8750-b15e5e8c8cbe tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.160594 Jun 15 15:03:37.364042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 524/1050] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:37 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:38.385877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:38.385877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:38.387875 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.388364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.389710 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.390171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.553234 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-a5c088eb-bce2-4fc7-9db0-1fd8fe470601 req-9a4ec63c-a29c-4997-b593-97b6022d761a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fef7f2a-f9c1-4903-a741-91693d3e88da", "name": "network-vif-plugged", "status": "completed", "tag": "9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:38.561801 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:38.566053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-a5c088eb-bce2-4fc7-9db0-1fd8fe470601 req-9a4ec63c-a29c-4997-b593-97b6022d761a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.566507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-a5c088eb-bce2-4fc7-9db0-1fd8fe470601 req-9a4ec63c-a29c-4997-b593-97b6022d761a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.570151 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-55c67afe-cdee-45c5-b5c3-402c1df0b1e9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.193712 Jun 15 15:03:38.570730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 527/1051] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:38 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:38.583892 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-a5c088eb-bce2-4fc7-9db0-1fd8fe470601 req-9a4ec63c-a29c-4997-b593-97b6022d761a service nova] Creating event network-vif-plugged:9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde for instance 7fef7f2a-f9c1-4903-a741-91693d3e88da on hv-cinder-78729 Jun 15 15:03:38.588861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-a5c088eb-bce2-4fc7-9db0-1fd8fe470601 req-9a4ec63c-a29c-4997-b593-97b6022d761a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039459 Jun 15 15:03:38.589456 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 525/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:03:39.586872 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:39.587476 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:39.589314 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:39.589999 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:39.595969 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.596506 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.597284 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.597763 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.737018 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:39.744618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d126f8c1-d732-4bda-a5ec-0cf58fcea62c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.161672 Jun 15 15:03:39.745188 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 528/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:39 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:40.759329 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:40.763803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:40.764631 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:40.771199 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.771486 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.772287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.772730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.909580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:40.917370 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4f76b466-03aa-4346-ac84-3606df91a857 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1366 microversion: 2.1 time: 0.159005 Jun 15 15:03:40.917936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 526/1054] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:40 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:41.934519 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:41.935235 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:41.942324 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:41.942748 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:41.943526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:41.943963 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.084617 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:42.092693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8ee9d81c-62a5-4d22-be91-5a776ef1eac7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1555 microversion: 2.1 time: 0.162002 Jun 15 15:03:42.093288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 529/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:41 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:42.109729 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9e8864f3-512b-427f-8286-5b19fa1a0063 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:42.110468 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9e8864f3-512b-427f-8286-5b19fa1a0063 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:42.116966 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e8864f3-512b-427f-8286-5b19fa1a0063 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.117422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e8864f3-512b-427f-8286-5b19fa1a0063 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.118191 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e8864f3-512b-427f-8286-5b19fa1a0063 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.118634 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e8864f3-512b-427f-8286-5b19fa1a0063 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.200908 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9e8864f3-512b-427f-8286-5b19fa1a0063 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095258 Jun 15 15:03:42.201509 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 527/1056] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 15:03:42 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:43.190051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-ef804360-6d7a-4a54-bb6f-6eb41eaa7e49 req-0d040be3-d58f-42d0-993e-b589c3381352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fef7f2a-f9c1-4903-a741-91693d3e88da", "tag": "9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:43.198855 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-ef804360-6d7a-4a54-bb6f-6eb41eaa7e49 req-0d040be3-d58f-42d0-993e-b589c3381352 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:43.199370 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-ef804360-6d7a-4a54-bb6f-6eb41eaa7e49 req-0d040be3-d58f-42d0-993e-b589c3381352 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:43.214259 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-ef804360-6d7a-4a54-bb6f-6eb41eaa7e49 req-0d040be3-d58f-42d0-993e-b589c3381352 service nova] Creating event network-changed:9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde for instance 7fef7f2a-f9c1-4903-a741-91693d3e88da on hv-cinder-78729 Jun 15 15:03:43.219889 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-ef804360-6d7a-4a54-bb6f-6eb41eaa7e49 req-0d040be3-d58f-42d0-993e-b589c3381352 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033539 Jun 15 15:03:43.220594 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 530/1057] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:13.376895 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:13.377660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=32 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:13.381520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-454588462", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "networks": [{"uuid": "3ca454dc-1869-4ede-ac83-ed40e87be810"}]}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:13.434667 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] validate_networks() for [('3ca454dc-1869-4ede-ac83-ed40e87be810', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:04:13.838406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:04:13.838829 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:04:13.839440 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:04:13.839856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:04:13.840311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:04:13.849798 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:13.850239 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:13.851030 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:13.851462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:13.868787 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Getting quotas for project 3efcbca3db4f49c6a11803516941ebe1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:04:13.872969 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Getting quotas for user ae775f33122c48fabd917accd0e6cb16 and project 3efcbca3db4f49c6a11803516941ebe1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:04:13.884077 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:04:13.886493 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:04:14.006612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-df6251f2-d1f7-4868-b003-d9bee16c0018 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631627 Jun 15 15:04:14.007282 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 528/1058] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:04:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:04:14.015624 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:14.016633 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=46 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:14.021010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-34bd3ea2-a308-4222-b199-119e01b7d80b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:14.021721 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-34bd3ea2-a308-4222-b199-119e01b7d80b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:14.078242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-34bd3ea2-a308-4222-b199-119e01b7d80b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:14.086636 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-34bd3ea2-a308-4222-b199-119e01b7d80b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1218 microversion: 2.1 time: 0.072950 Jun 15 15:04:14.087117 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 531/1059] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:14 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:15.106427 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bcf2aa18-3461-4a0b-b41c-82f7d4e6a4c2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:15.107049 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bcf2aa18-3461-4a0b-b41c-82f7d4e6a4c2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:15.160999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bcf2aa18-3461-4a0b-b41c-82f7d4e6a4c2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:15.168882 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bcf2aa18-3461-4a0b-b41c-82f7d4e6a4c2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1218 microversion: 2.1 time: 0.067847 Jun 15 15:04:15.169444 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 529/1060] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:15 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:16.186839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ba54760d-b392-4cfa-8a1b-2eebf807b079 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:16.187529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ba54760d-b392-4cfa-8a1b-2eebf807b079 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:16.242561 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ba54760d-b392-4cfa-8a1b-2eebf807b079 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:16.249784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ba54760d-b392-4cfa-8a1b-2eebf807b079 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1218 microversion: 2.1 time: 0.066932 Jun 15 15:04:16.250936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 532/1061] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:16 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:17.267089 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-97d470e5-7e36-40b8-af78-047c5ae95fe1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:17.268504 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-97d470e5-7e36-40b8-af78-047c5ae95fe1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:17.321755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-97d470e5-7e36-40b8-af78-047c5ae95fe1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:17.328377 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-97d470e5-7e36-40b8-af78-047c5ae95fe1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1218 microversion: 2.1 time: 0.065083 Jun 15 15:04:17.328936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 530/1062] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:17 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:18.346228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:18.346967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:18.353557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:18.354003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:18.354771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:18.355211 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:18.419051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:18.427230 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b2a99b50-aac2-43e7-b2b7-6d128cf67989 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1222 microversion: 2.1 time: 0.085476 Jun 15 15:04:18.427798 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 533/1063] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:18 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:19.444830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:19.445448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:19.452669 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:19.453121 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:19.453881 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:19.454314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:19.516584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:19.524549 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-97776ae4-b4a8-4687-bb69-09ca735b04c5 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1214 microversion: 2.1 time: 0.083695 Jun 15 15:04:19.525136 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 531/1064] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:19 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:20.556002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:20.557112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:20.564799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:20.565267 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:20.566052 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:20.566493 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:20.631768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:20.640751 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6e568096-bee8-4b3a-91ee-6af7ebc90bf3 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1276 microversion: 2.1 time: 0.088627 Jun 15 15:04:20.641711 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 534/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:20 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:21.659900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:21.662771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:21.667166 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:21.667563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:21.668372 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:21.668816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:21.805490 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:21.813219 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1be6cd8d-5d39-4533-85fe-96b471981541 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.158447 Jun 15 15:04:21.813805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 532/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:21 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:21.841458 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-c6e46746-4ee8-48f2-87d9-cdcf3fe3b915 req-aa7f33ec-6f8a-4c10-8740-2786d87fa617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab469f4b-3c83-445e-a779-66f20fdd7723", "tag": "cfaaaa07-9b37-48bf-8475-379ac48f05be"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:21.861400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c6e46746-4ee8-48f2-87d9-cdcf3fe3b915 req-aa7f33ec-6f8a-4c10-8740-2786d87fa617 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:21.861942 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-c6e46746-4ee8-48f2-87d9-cdcf3fe3b915 req-aa7f33ec-6f8a-4c10-8740-2786d87fa617 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:21.873737 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-c6e46746-4ee8-48f2-87d9-cdcf3fe3b915 req-aa7f33ec-6f8a-4c10-8740-2786d87fa617 service nova] Creating event network-changed:cfaaaa07-9b37-48bf-8475-379ac48f05be for instance ab469f4b-3c83-445e-a779-66f20fdd7723 on hv-cinder-78729 Jun 15 15:04:21.879163 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-c6e46746-4ee8-48f2-87d9-cdcf3fe3b915 req-aa7f33ec-6f8a-4c10-8740-2786d87fa617 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042676 Jun 15 15:04:21.879979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 535/1067] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:22.831687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:22.832365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:22.838909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:22.839406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:22.840300 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:22.840674 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:22.972803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:22.980267 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2e3d8bc2-5e2d-4b52-b4ee-668cf5781218 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.153485 Jun 15 15:04:22.980840 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 533/1068] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:22 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:23.997892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:23.998505 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:24.005904 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:24.006357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:24.007126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:24.007564 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:24.144874 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:24.152488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-fabac2eb-8346-4cc7-91e4-a58d888ccfde tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.159107 Jun 15 15:04:24.153053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 536/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:23 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:25.170219 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:25.170874 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:25.173331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:25.179044 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:25.182324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:25.182324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:25.182324 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:25.313243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:25.321046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8f213a2f-e65c-4f37-bd18-b78011f4c4cb tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.154645 Jun 15 15:04:25.321618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 534/1070] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:25 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:26.338126 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:26.338698 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:26.341082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:26.346024 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:26.349100 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:26.349100 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:26.349100 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:26.483053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:26.491317 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-26dd3cfe-61a5-491a-8037-08ec9206d53d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.157144 Jun 15 15:04:26.491874 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 537/1071] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:26 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:27.508404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:27.508947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:27.510738 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=10 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:27.515561 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:27.516003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:27.516813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:27.517246 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:27.650915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:27.658755 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8a54e9a2-cf80-482b-b623-6e54e17d8c0d tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.154451 Jun 15 15:04:27.659313 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 535/1072] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:27 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:28.675837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:28.676945 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:28.683082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:28.683537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:28.684342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:28.684787 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:28.754937 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-bdd4b649-a2ef-44d0-8b87-aa1f80a6dc74 req-e315f6e4-75e3-424d-8c1a-97217f50e2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab469f4b-3c83-445e-a779-66f20fdd7723", "name": "network-vif-plugged", "status": "completed", "tag": "cfaaaa07-9b37-48bf-8475-379ac48f05be"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:28.763650 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-bdd4b649-a2ef-44d0-8b87-aa1f80a6dc74 req-e315f6e4-75e3-424d-8c1a-97217f50e2ba service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:28.764400 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-bdd4b649-a2ef-44d0-8b87-aa1f80a6dc74 req-e315f6e4-75e3-424d-8c1a-97217f50e2ba service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:28.776320 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-bdd4b649-a2ef-44d0-8b87-aa1f80a6dc74 req-e315f6e4-75e3-424d-8c1a-97217f50e2ba service nova] Creating event network-vif-plugged:cfaaaa07-9b37-48bf-8475-379ac48f05be for instance ab469f4b-3c83-445e-a779-66f20fdd7723 on hv-cinder-78729 Jun 15 15:04:28.781480 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-bdd4b649-a2ef-44d0-8b87-aa1f80a6dc74 req-e315f6e4-75e3-424d-8c1a-97217f50e2ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030559 Jun 15 15:04:28.784067 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 536/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:04:28.822582 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:28.830360 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1ce0d2dd-5848-4361-97e0-c910268f3cfa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.159429 Jun 15 15:04:28.830931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 538/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:28 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:29.848995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:29.849722 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:29.856014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:29.856618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:29.857388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:29.857828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:29.990627 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:29.998397 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7cde88cb-2efa-445c-9ef1-3f5e1273e2ba tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1318 microversion: 2.1 time: 0.154714 Jun 15 15:04:29.998961 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 537/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:29 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:31.014917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:31.015534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:31.022264 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.022713 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.023481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.023913 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.155155 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:31.163521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-56cf1402-5ed2-4e8c-9948-81cbddbb6a30 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1508 microversion: 2.1 time: 0.152633 Jun 15 15:04:31.164111 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 539/1076] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:31 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:54.962192 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1f2ba0bd-ece2-4c9e-9cd0-da41a342b661 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f769853-97b6-4881-9167-b8f844786862", "device": "/dev/sdb"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:54.963749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1f2ba0bd-ece2-4c9e-9cd0-da41a342b661 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:54.966486 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:54.967158 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=40 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:54.973142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f2ba0bd-ece2-4c9e-9cd0-da41a342b661 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:54.973591 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f2ba0bd-ece2-4c9e-9cd0-da41a342b661 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:54.974364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f2ba0bd-ece2-4c9e-9cd0-da41a342b661 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:54.974797 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f2ba0bd-ece2-4c9e-9cd0-da41a342b661 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:55.506222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1f2ba0bd-ece2-4c9e-9cd0-da41a342b661 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "POST /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548049 Jun 15 15:04:55.507057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 538/1077] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:04:54 2022] POST /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:20.947823 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:20.948440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:20.950322 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=22 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:20.951016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=38 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:20.955708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:20.956257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:20.957020 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:20.957480 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:20.982257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:05:21.216406 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f01dfb5f-2be3-4d5a-8395-25ccf97be4d2 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 204 len: 0 microversion: 2.1 time: 0.272390 Jun 15 15:05:21.216991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 540/1078] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:05:20 2022] DELETE /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:05:21.224014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:21.224830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:21.228961 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:21.229687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:21.235911 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:21.236402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:21.237247 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:21.237688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:21.482385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:21.489934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3eb0efa0-1da0-4eee-ae30-be62c259daec tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1575 microversion: 2.1 time: 0.268335 Jun 15 15:05:21.490535 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 539/1079] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:21 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:22.507906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:22.508631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:22.515113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:22.515560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:22.520299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:22.520299 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:22.702074 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:22.709782 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f04da276-d40a-4c46-9e2a-53f6dc172c89 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1575 microversion: 2.1 time: 0.206841 Jun 15 15:05:22.710340 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 541/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:22 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:23.727803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:23.728450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:23.735141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.735600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:23.736418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.736878 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:23.923022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:23.931383 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d0b124d6-c75d-4d07-8902-1dd4558e996f tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1575 microversion: 2.1 time: 0.207822 Jun 15 15:05:23.931962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 540/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:23 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:24.405605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-37dece1e-f001-4acc-bcb2-4fde843fcbe8 req-cfeff4f5-ea10-4d65-aff6-a302eab9ba64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4fc143-9763-4dfc-94c5-2cddc7e27c0e", "name": "network-vif-deleted", "tag": "f35a17de-d34b-452e-8f02-ea62fa068cb1"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:24.427386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-37dece1e-f001-4acc-bcb2-4fde843fcbe8 req-cfeff4f5-ea10-4d65-aff6-a302eab9ba64 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:24.427841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-37dece1e-f001-4acc-bcb2-4fde843fcbe8 req-cfeff4f5-ea10-4d65-aff6-a302eab9ba64 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:24.440192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-37dece1e-f001-4acc-bcb2-4fde843fcbe8 req-cfeff4f5-ea10-4d65-aff6-a302eab9ba64 service nova] Creating event network-vif-deleted:f35a17de-d34b-452e-8f02-ea62fa068cb1 for instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e on hv-cinder-78729 Jun 15 15:05:24.446656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-37dece1e-f001-4acc-bcb2-4fde843fcbe8 req-cfeff4f5-ea10-4d65-aff6-a302eab9ba64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045238 Jun 15 15:05:24.450439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 542/1082] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:24.951456 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:24.952902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:24.960536 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:24.960981 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:24.961991 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:24.962422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:25.031713 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:25.040506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a066541-9e22-4a55-a770-f2220effba24 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 200 len: 1224 microversion: 2.1 time: 0.095901 Jun 15 15:05:25.041588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 541/1083] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:24 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:25.446388 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:25.446983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:25.453771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:25.454291 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:25.455456 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:25.455897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:25.546410 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lazy-loading 'services' on Instance uuid ab469f4b-3c83-445e-a779-66f20fdd7723 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:05:25.804661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bb11d006-da8a-4f1c-91b6-7b96e8467476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723/os-volume_attachments/8f769853-97b6-4881-9167-b8f844786862" status: 202 len: 0 microversion: 2.1 time: 0.363442 Jun 15 15:05:25.805253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 543/1084] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 15:05:25 2022] DELETE /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723/os-volume_attachments/8f769853-97b6-4881-9167-b8f844786862 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:05:26.058542 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:26.059075 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:26.065960 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.066685 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.067507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.067948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.082330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] HTTP exception thrown: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Request method failure captured: Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e HTTP/1.1 Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfRC5cW0pZVip5HQhOYojseVu49hHlWKcXXx0ZjEEb0cQlsNP0QI8UAtkMbIN2nDTOrE8dmfEfWW-u4LSyzdvYBonYjtEaI5O0fRyUXnWCUbMlER842SotanYKJzHMzomrpdPlDO7muWX2EeBGPCx8glfgbRqwJO043F2tPxsODFr0Y Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:05:26.084130 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-TestVolumeBootPattern-362759903 Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: e209ae2f7fa7412b95c7c43c74c14426 Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:05:26.086248 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'ed4fc143-9763-4dfc-94c5-2cddc7e27c0e'} Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:05:26.089122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:05:26.093131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:26.098465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Returning 404 to user: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:05:26.098465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-90ede415-92c5-4dbd-8ecf-47470099baee tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 404 len: 111 microversion: 2.1 time: 0.031106 Jun 15 15:05:26.098465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 542/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:26 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:05:26.192369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2096920146", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-993253485", "security_groups": [{"name": "tempest-secgroup-smoke-693886938"}], "block_device_mapping_v2": [{"uuid": "a86fb604-dea9-4f2f-ae2a-45592d68c472", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae29f25b-1566-4281-8605-e2a4f3901460"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:26.305642 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] validate_networks() for [('ae29f25b-1566-4281-8605-e2a4f3901460', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:05:26.691590 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:05:26.693390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:05:26.693390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:05:26.693390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:05:26.693700 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:05:26.703345 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.703792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.704631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.705072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.722259 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:05:26.726723 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for user e209ae2f7fa7412b95c7c43c74c14426 and project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:05:26.788489 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:05:26.790845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a86fb604-dea9-4f2f-ae2a-45592d68c472',volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:05:26.975508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:26.976010 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:26.982133 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.982584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.983356 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.983791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.009362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Going to try to terminate instance {{(pid=124660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:05:27.241113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-77112b0b-febd-4e76-b36c-3e4e2e86dc72 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.053602 Jun 15 15:05:27.241862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 544/1086] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:05:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:05:27.252392 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d561ee6c-b14d-4a95-9aa4-8010b857b7be tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:27.253017 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d561ee6c-b14d-4a95-9aa4-8010b857b7be tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:27.313645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d561ee6c-b14d-4a95-9aa4-8010b857b7be tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:27.323249 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d561ee6c-b14d-4a95-9aa4-8010b857b7be tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1094 microversion: 2.1 time: 0.073488 Jun 15 15:05:27.323249 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 545/1087] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:27 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:27.359161 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-dea0b97b-a6d9-46a4-a3f2-a8262721cce9 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 204 len: 0 microversion: 2.1 time: 0.388081 Jun 15 15:05:27.359792 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 543/1088] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:05:26 2022] DELETE /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:05:27.368309 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:27.368971 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:27.375602 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:27.376364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.379693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:27.379693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.512557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:27.520697 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-20325b8b-dd65-472c-a985-8d1290a4669b tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1514 microversion: 2.1 time: 0.155952 Jun 15 15:05:27.521262 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 546/1089] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:27 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:28.340055 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:28.340747 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:28.347232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.347760 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.349375 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.349824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.412173 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:28.419939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f62bbaef-3f39-4d47-9dfe-191e4173d085 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1144 microversion: 2.1 time: 0.084157 Jun 15 15:05:28.420554 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 544/1090] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:28 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:28.539104 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:28.539898 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:28.546598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.547054 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.547835 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.548341 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.684371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:28.692935 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-51d6e560-92bf-4806-a37a-ef5091987d36 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1514 microversion: 2.1 time: 0.158733 Jun 15 15:05:28.693513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 547/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:28 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:29.436970 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:29.437592 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:29.445219 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.445687 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.446460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.446902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.513128 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:29.522718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3390fcfd-aa95-4d79-81bb-7b0e2fefce94 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1192 microversion: 2.1 time: 0.089123 Jun 15 15:05:29.523322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 545/1092] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:29 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:29.710897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:29.711559 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:29.718324 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.718777 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.719563 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.720000 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.854077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:29.861832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e1cbc3d4-9f01-4cfe-b462-6c55e7ca0f21 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1514 microversion: 2.1 time: 0.155646 Jun 15 15:05:29.862377 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 548/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:29 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:30.433588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-ecc68329-c4b3-4ea5-b6a1-14c880b7b016 req-caf26404-93d3-44af-9a1e-75120c57ed8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab469f4b-3c83-445e-a779-66f20fdd7723", "name": "network-vif-deleted", "tag": "cfaaaa07-9b37-48bf-8475-379ac48f05be"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:30.442638 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-ecc68329-c4b3-4ea5-b6a1-14c880b7b016 req-caf26404-93d3-44af-9a1e-75120c57ed8a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:30.443330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-ecc68329-c4b3-4ea5-b6a1-14c880b7b016 req-caf26404-93d3-44af-9a1e-75120c57ed8a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:30.456160 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-ecc68329-c4b3-4ea5-b6a1-14c880b7b016 req-caf26404-93d3-44af-9a1e-75120c57ed8a service nova] Creating event network-vif-deleted:cfaaaa07-9b37-48bf-8475-379ac48f05be for instance ab469f4b-3c83-445e-a779-66f20fdd7723 on hv-cinder-78729 Jun 15 15:05:30.466712 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-ecc68329-c4b3-4ea5-b6a1-14c880b7b016 req-caf26404-93d3-44af-9a1e-75120c57ed8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033468 Jun 15 15:05:30.468710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 546/1094] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:30.541038 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:30.541845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:30.550473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:30.550473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:30.550473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:30.550473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:30.618779 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:30.629462 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5f98f4d9-ceef-44d6-ac2d-a1a0dcd62058 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1210 microversion: 2.1 time: 0.091146 Jun 15 15:05:30.630828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 549/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:30 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:30.879770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:30.880547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:30.889165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:30.892773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:30.892773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:30.892773 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:30.923715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:30.924201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:30.924666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lazy-loading 'fault' on Instance uuid ab469f4b-3c83-445e-a779-66f20fdd7723 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:05:30.969603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:30.978360 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-906b53c5-4168-4be9-a3e8-22e137774773 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 200 len: 1308 microversion: 2.1 time: 0.103175 Jun 15 15:05:30.978934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 547/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:30 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:31.647326 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:31.647974 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:31.654936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:31.655387 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:31.656196 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:31.656637 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:31.808586 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:31.817885 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3fee2d56-ca12-4417-a37b-caa011ab8ee8 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1277 microversion: 2.1 time: 0.174864 Jun 15 15:05:31.818471 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 550/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:31 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:32.003451 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:32.003451 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: ab469f4b-3c83-445e-a779-66f20fdd7723] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:32.007051 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:32.007581 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:32.008680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:32.008986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:32.028320 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] HTTP exception thrown: Instance ab469f4b-3c83-445e-a779-66f20fdd7723 could not be found. Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Request method failure captured: Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 HTTP/1.1 Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfTqdusDra8P5O2aSGT4Oud5R0-AON91I-rsjszCGUFyzVacrK61NsDEVFqMxw1DS7CNpT6ifXWqxq1dkyDWur7E5_4vxV9X6uyeTo5NGB6-15W46qjai4wklHRTjiRBJ4wsPTCgsdWrEGoo7hFpD4DtCBLfn-rCOPD-W1JxtOID-AY Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 3efcbca3db4f49c6a11803516941ebe1 Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-404446456 Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:05:32.032287 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-VolumesSnapshotTestJSON-404446456 Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 3efcbca3db4f49c6a11803516941ebe1 Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-404446456 Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-VolumesSnapshotTestJSON-404446456-project Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: ae775f33122c48fabd917accd0e6cb16 Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-VolumesSnapshotTestJSON-404446456-project Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance ab469f4b-3c83-445e-a779-66f20fdd7723 could not be found. Jun 15 15:05:32.033850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'ab469f4b-3c83-445e-a779-66f20fdd7723'} Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab469f4b-3c83-445e-a779-66f20fdd7723 could not be found. Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:05:32.034659 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab469f4b-3c83-445e-a779-66f20fdd7723 could not be found. Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab469f4b-3c83-445e-a779-66f20fdd7723 could not be found. Jun 15 15:05:32.037084 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:05:32.038764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Returning 404 to user: Instance ab469f4b-3c83-445e-a779-66f20fdd7723 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:05:32.038764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-00470789-e2e0-4a8b-bfbf-c383b0e4e497 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723" status: 404 len: 111 microversion: 2.1 time: 0.039602 Jun 15 15:05:32.038764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 548/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:31 2022] GET /compute/v2.1/servers/ab469f4b-3c83-445e-a779-66f20fdd7723 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:05:32.079924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-2db78f1a-03c5-479e-a40e-991b1b2ed890 req-2b13e3ac-42fe-40cf-abb8-195417c12a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f19b50f-eeeb-469a-8308-6e04555a0f56", "tag": "5ee28d82-6aee-4db2-889f-d8743703bdb7"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:32.090105 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2db78f1a-03c5-479e-a40e-991b1b2ed890 req-2b13e3ac-42fe-40cf-abb8-195417c12a9c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:32.090384 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-2db78f1a-03c5-479e-a40e-991b1b2ed890 req-2b13e3ac-42fe-40cf-abb8-195417c12a9c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:32.103194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-2db78f1a-03c5-479e-a40e-991b1b2ed890 req-2b13e3ac-42fe-40cf-abb8-195417c12a9c service nova] Creating event network-changed:5ee28d82-6aee-4db2-889f-d8743703bdb7 for instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 on hv-cinder-78729 Jun 15 15:05:32.108392 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-2db78f1a-03c5-479e-a40e-991b1b2ed890 req-2b13e3ac-42fe-40cf-abb8-195417c12a9c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032777 Jun 15 15:05:32.109209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 551/1099] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:32.835417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:32.835948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:32.842026 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:32.842481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:32.843252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:32.843690 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:32.977188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:32.985801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-32d09224-d957-4182-ad19-dd751aec0c2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.154330 Jun 15 15:05:32.986363 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 549/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:32 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:34.005232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:34.006294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:34.012592 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:34.013046 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:34.013828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:34.014292 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:34.153739 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:34.161497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4e1d51fa-6f48-4c75-ad14-4ddd6f6c3324 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.162005 Jun 15 15:05:34.162065 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 552/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:33 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:35.182167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:35.182893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:35.189732 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:35.190177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:35.190957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:35.191593 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:35.325525 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:35.334364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2c45642c-7190-4b1f-9134-6aa5e6f571af tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.158883 Jun 15 15:05:35.334945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 550/1102] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:35 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:36.351640 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:36.352260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:36.359321 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:36.359771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:36.360584 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:36.361027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:36.494527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:36.502301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-08f87629-f4fa-4667-9f19-9a5340eae1ab tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.155384 Jun 15 15:05:36.502972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 553/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:36 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:37.519706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:37.520462 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:37.527618 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:37.528070 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:37.528889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:37.529343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:37.894496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:37.894496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-46bb90df-006e-4574-afdc-607e5d750fea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.174883 Jun 15 15:05:37.894496 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 551/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:37 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:38.709776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:38.710521 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:38.712589 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:38.713306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=8 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:38.718755 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:38.719214 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:38.719992 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:38.720478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:38.852626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:38.860008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9d9f5c4d-e47f-4c4c-90b4-9bd797a9b655 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.155122 Jun 15 15:05:38.860615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 554/1105] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:38 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:39.233376 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c82809a6-7ab0-43d4-97ae-670337382e50 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:39.234041 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c82809a6-7ab0-43d4-97ae-670337382e50 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:39.241434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c82809a6-7ab0-43d4-97ae-670337382e50 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:39.241885 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c82809a6-7ab0-43d4-97ae-670337382e50 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:39.242660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c82809a6-7ab0-43d4-97ae-670337382e50 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:39.243099 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c82809a6-7ab0-43d4-97ae-670337382e50 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:39.266935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c82809a6-7ab0-43d4-97ae-670337382e50 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/ips" status: 200 len: 149 microversion: 2.1 time: 0.037509 Jun 15 15:05:39.267501 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 552/1106] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 15:05:39 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:39.877991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:39.878602 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:39.885765 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:39.886215 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:39.886984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:39.887427 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:40.026795 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:40.034641 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-219a3ec7-feca-4328-a21d-bb6218f54eb6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.160582 Jun 15 15:05:40.035205 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 555/1107] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:39 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:41.052178 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:41.052781 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:41.059396 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:41.059841 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:41.060637 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:41.061073 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:41.197955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:41.205679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c0882a66-bf15-49e2-8d7c-fcf4293a45de tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.157387 Jun 15 15:05:41.206238 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 553/1108] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:41 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:42.223271 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:42.223878 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:42.231147 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:42.231593 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:42.232429 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:42.232869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:42.366525 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:42.374350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9705a5ae-67c9-4613-b603-e5acf421f25b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.155052 Jun 15 15:05:42.375019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 556/1109] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:42 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:43.391917 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:43.392610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:43.399495 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:43.400015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:43.400810 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:43.401253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:43.535602 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:43.543456 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-26c503c9-94c6-49e2-8030-98c7617727ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.155370 Jun 15 15:05:43.544026 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 554/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:43 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:44.561035 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:44.561656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:44.568357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:44.568810 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:44.569608 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:44.570073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:44.574845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:44.703542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:44.711005 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-28963616-056c-47bf-8545-6ac846ad94b0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.154732 Jun 15 15:05:44.711578 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 557/1111] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:44 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:44.766417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1073392398", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "networks": [{"uuid": "3ca454dc-1869-4ede-ac83-ed40e87be810"}]}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:44.820314 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] validate_networks() for [('3ca454dc-1869-4ede-ac83-ed40e87be810', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:05:45.163226 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:05:45.163649 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:05:45.164153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:05:45.164566 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:05:45.164975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:05:45.174637 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:45.175077 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:45.175907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:45.176380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:45.193988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Getting quotas for project 3efcbca3db4f49c6a11803516941ebe1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:05:45.198584 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Getting quotas for user ae775f33122c48fabd917accd0e6cb16 and project 3efcbca3db4f49c6a11803516941ebe1. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:05:45.209927 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:05:45.212215 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:05:45.213526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b226cbde-6a25-42df-88de-93dbd84606c8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b0c0d27-a558-4a1e-8715-c829c87a0ed7"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:45.214390 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b226cbde-6a25-42df-88de-93dbd84606c8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:45.220789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b226cbde-6a25-42df-88de-93dbd84606c8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:45.221236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b226cbde-6a25-42df-88de-93dbd84606c8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:45.221996 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b226cbde-6a25-42df-88de-93dbd84606c8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:45.222430 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b226cbde-6a25-42df-88de-93dbd84606c8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:45.338013 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7c4a8344-f2da-4195-8421-d5b892578068 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575370 Jun 15 15:05:45.338702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 555/1112] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:05:45.351197 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1cad45e5-218a-43a9-969a-d62182e14476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:45.352345 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1cad45e5-218a-43a9-969a-d62182e14476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:45.419950 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1cad45e5-218a-43a9-969a-d62182e14476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:45.427319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1cad45e5-218a-43a9-969a-d62182e14476 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1219 microversion: 2.1 time: 0.082483 Jun 15 15:05:45.427870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 556/1113] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:45 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:45.728544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:45.729158 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:45.735149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:45.735598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:45.736389 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:45.736822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:45.769418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:45.889708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:45.897801 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6c9d6f2c-60c5-4886-ac14-0b57609e8772 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.173161 Jun 15 15:05:45.898377 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 557/1114] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:45 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:46.169757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b226cbde-6a25-42df-88de-93dbd84606c8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959914 Jun 15 15:05:46.170312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 558/1115] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:05:45 2022] POST /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:05:46.453934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:46.453934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:46.454979 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.455446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:46.456256 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.456697 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:46.521198 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:46.529975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b19d03d5-143c-4efc-ab54-677e8577dace tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1223 microversion: 2.1 time: 0.088114 Jun 15 15:05:46.530683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 558/1116] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:46 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:46.915217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:46.916029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:46.923429 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.923898 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:46.924797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.925257 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:47.072923 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:47.080666 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-79c86487-f876-4755-b394-521a8ff9a61c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.169600 Jun 15 15:05:47.081248 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 559/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:46 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:47.546824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:47.547443 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:47.554724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:47.555185 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:47.556003 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:47.556456 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:47.622624 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:47.630368 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-af92401b-193c-46fe-be27-402e51b81c09 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1271 microversion: 2.1 time: 0.087314 Jun 15 15:05:47.631007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 559/1118] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:47 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:48.105944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:48.105944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:48.110530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:48.111023 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:48.111832 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:48.112296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:48.254191 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:48.263871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-47ef6f22-aa36-4649-967a-fdf7d1fcabe0 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.169470 Jun 15 15:05:48.273436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 560/1119] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:48 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:48.648528 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:48.649103 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:48.656922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:48.657380 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:48.658165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:48.658605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:48.725282 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:48.733350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-aec63188-d43d-4c04-a92e-479253fe4871 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1277 microversion: 2.1 time: 0.088977 Jun 15 15:05:48.738238 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 560/1120] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:48 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:49.204171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-b3552064-bfb3-4f72-baba-d273127bf1ad req-4a723bf0-ebaa-4638-95c4-dc3bac4eba75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f19b50f-eeeb-469a-8308-6e04555a0f56", "name": "network-vif-plugged", "status": "completed", "tag": "5ee28d82-6aee-4db2-889f-d8743703bdb7"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:49.211685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b3552064-bfb3-4f72-baba-d273127bf1ad req-4a723bf0-ebaa-4638-95c4-dc3bac4eba75 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.212160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b3552064-bfb3-4f72-baba-d273127bf1ad req-4a723bf0-ebaa-4638-95c4-dc3bac4eba75 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.224530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-b3552064-bfb3-4f72-baba-d273127bf1ad req-4a723bf0-ebaa-4638-95c4-dc3bac4eba75 service nova] Creating event network-vif-plugged:5ee28d82-6aee-4db2-889f-d8743703bdb7 for instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 on hv-cinder-78729 Jun 15 15:05:49.231328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-b3552064-bfb3-4f72-baba-d273127bf1ad req-4a723bf0-ebaa-4638-95c4-dc3bac4eba75 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033712 Jun 15 15:05:49.231954 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 561/1121] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:49.283880 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:49.285141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:49.293459 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.294271 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.295407 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.295957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.447863 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:49.456039 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8c8188d1-d31d-48ae-9843-d01e2b3d6840 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.178254 Jun 15 15:05:49.456653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 561/1122] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:49 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:49.751674 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:49.752562 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:49.758972 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.759501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.761423 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.761423 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.782018 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-7b17832f-f682-408b-9ca6-92a2d10cd52e req-fbf89bd9-6086-4e16-aba8-8884aa22f0eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61292e0f-c494-49da-ad70-9a5bc5103952", "tag": "6f029218-c947-4f38-8be5-36724ad44714"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:49.791503 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-7b17832f-f682-408b-9ca6-92a2d10cd52e req-fbf89bd9-6086-4e16-aba8-8884aa22f0eb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.792679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-7b17832f-f682-408b-9ca6-92a2d10cd52e req-fbf89bd9-6086-4e16-aba8-8884aa22f0eb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.805247 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-7b17832f-f682-408b-9ca6-92a2d10cd52e req-fbf89bd9-6086-4e16-aba8-8884aa22f0eb service nova] Creating event network-changed:6f029218-c947-4f38-8be5-36724ad44714 for instance 61292e0f-c494-49da-ad70-9a5bc5103952 on hv-cinder-78729 Jun 15 15:05:49.810859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-7b17832f-f682-408b-9ca6-92a2d10cd52e req-fbf89bd9-6086-4e16-aba8-8884aa22f0eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033530 Jun 15 15:05:49.811471 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 562/1123] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:49.907997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:49.915351 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-721e24e4-eed9-4be7-b2db-ba3a70c86421 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.168112 Jun 15 15:05:49.915937 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 562/1124] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:49 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:50.473951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:50.474656 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:50.481372 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:50.481823 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:50.482589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:50.483027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:50.616559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:50.624988 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c36e52a2-3db1-4f22-8413-9d356f1bba14 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1265 microversion: 2.1 time: 0.155294 Jun 15 15:05:50.625779 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 563/1125] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:50 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:50.932569 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:50.933189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:50.940198 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:50.940670 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:50.941437 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:50.941868 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:51.078862 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:51.086557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d77a86b6-4ca7-49ab-8876-0c0e5d7ef795 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.157881 Jun 15 15:05:51.087139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 563/1126] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:50 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:51.641303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:51.641915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:51.644388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:51.649232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:51.649614 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:51.650396 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:51.650815 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:51.786970 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:51.795482 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c6237c1a-9557-4b4f-af07-44444590e975 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1452 microversion: 2.1 time: 0.158067 Jun 15 15:05:51.796056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 564/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:51 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:51.811660 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:51.812461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:51.814453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:51.819447 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:51.819889 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:51.820699 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:51.821132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:51.956435 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:51.964516 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ac6a33cf-7bd0-4c6f-9440-4ad151caa49e tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1452 microversion: 2.1 time: 0.156685 Jun 15 15:05:51.965092 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 564/1128] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:51 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:52.104937 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:52.105616 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:52.111634 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:52.112182 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:52.116290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:52.116290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:52.343628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:52.351682 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-c85cda66-4246-49f2-b63f-6dcfd9ac3af4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.251027 Jun 15 15:05:52.352469 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 565/1129] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:52 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:53.372051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:53.372706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:53.379646 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:53.380134 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:53.381213 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:53.381420 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:53.610692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:53.618714 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2c1b3be5-1a7c-4458-87d7-6da7fbea9a8c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.252713 Jun 15 15:05:53.619298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 565/1130] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:53 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:54.381319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-b8046ff7-78ba-42e8-9657-36dc816e06ed req-f48a04ca-31e8-4a16-bf5e-baca89201024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f19b50f-eeeb-469a-8308-6e04555a0f56", "tag": "5ee28d82-6aee-4db2-889f-d8743703bdb7"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:54.390191 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-b8046ff7-78ba-42e8-9657-36dc816e06ed req-f48a04ca-31e8-4a16-bf5e-baca89201024 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:54.390666 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-b8046ff7-78ba-42e8-9657-36dc816e06ed req-f48a04ca-31e8-4a16-bf5e-baca89201024 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:54.402436 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-b8046ff7-78ba-42e8-9657-36dc816e06ed req-f48a04ca-31e8-4a16-bf5e-baca89201024 service nova] Creating event network-changed:5ee28d82-6aee-4db2-889f-d8743703bdb7 for instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 on hv-cinder-78729 Jun 15 15:05:54.407823 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-b8046ff7-78ba-42e8-9657-36dc816e06ed req-f48a04ca-31e8-4a16-bf5e-baca89201024 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091403 Jun 15 15:05:54.408466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 566/1131] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:54.637493 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:54.638796 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:54.645709 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:54.646168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:54.646957 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:54.648138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:54.784854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:54.792579 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d3260353-4d24-4727-a88f-68a4a409b766 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.159854 Jun 15 15:05:54.797560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 566/1132] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:54 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:55.807053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:55.808541 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=8 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:55.812975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:55.813671 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:55.819771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:55.820243 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:55.820998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:55.821429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:55.963957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:55.973149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6b88875f-a610-4f42-beb4-1117f0e7ff16 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.166915 Jun 15 15:05:55.973742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 567/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:55 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:56.831002 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0fe5a2bb-aaaa-4838-bcfb-79690e3b141c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: .version_select at 0x7fb8a8534a60>, body: {"keypair": {"name": "tempest-keypair-1180971094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7c6oTLTMJJAxR1v6nqsQ1cCZm/JCpZDXlrgInTtMJqwM5+aQTUJlwBeIGVbbcXLQ7MFptbTlhjDu7Ed+eN2OJ/9tq7+RUV/oZW1KCOlNlUn6QDRPCWUokFibwODy2yWw=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:56.846345 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-0fe5a2bb-aaaa-4838-bcfb-79690e3b141c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:05:56.850112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-0fe5a2bb-aaaa-4838-bcfb-79690e3b141c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:05:56.948583 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0fe5a2bb-aaaa-4838-bcfb-79690e3b141c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121280 Jun 15 15:05:56.949186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 567/1134] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 15:05:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:56.990186 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:56.993662 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:56.999113 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:56.999565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:57.000372 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:57.000812 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:57.134856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:57.143771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-00c06096-8a17-4f27-a01a-1f13278f0fd4 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.157591 Jun 15 15:05:57.147962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 568/1135] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:56 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:58.161688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:58.162295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:58.168478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:58.168946 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:58.169707 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:58.170138 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:58.381759 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:58.389896 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-42572ae1-9d68-4628-843e-e016ec70768c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.232621 Jun 15 15:05:58.394183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 568/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:58 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:59.194200 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1779603910", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "115a225d-97b8-4fa4-b2b8-ad448d4e5db3"}], "security_groups": [{"name": "tempest-securitygroup--2092265334"}], "key_name": "tempest-keypair-1180971094", "user_data": "}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:59.233349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-6d154d47-85cc-4f01-83fb-f22574b4b07e req-8e150a66-2876-451a-8a07-330f6df1478c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61292e0f-c494-49da-ad70-9a5bc5103952", "name": "network-vif-plugged", "status": "completed", "tag": "6f029218-c947-4f38-8be5-36724ad44714"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:59.243186 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-6d154d47-85cc-4f01-83fb-f22574b4b07e req-8e150a66-2876-451a-8a07-330f6df1478c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:59.244145 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-6d154d47-85cc-4f01-83fb-f22574b4b07e req-8e150a66-2876-451a-8a07-330f6df1478c service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:59.255200 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-6d154d47-85cc-4f01-83fb-f22574b4b07e req-8e150a66-2876-451a-8a07-330f6df1478c service nova] Creating event network-vif-plugged:6f029218-c947-4f38-8be5-36724ad44714 for instance 61292e0f-c494-49da-ad70-9a5bc5103952 on hv-cinder-78729 Jun 15 15:05:59.260291 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-6d154d47-85cc-4f01-83fb-f22574b4b07e req-8e150a66-2876-451a-8a07-330f6df1478c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Jun 15 15:05:59.261240 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 569/1137] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:05:59.308076 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] validate_networks() for [('115a225d-97b8-4fa4-b2b8-ad448d4e5db3', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:05:59.407984 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:59.408703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:59.414991 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:59.415436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:59.416239 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:59.416676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:59.644931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:59.654243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-712b8e73-7930-4e12-ac6e-dc899362d3aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.250140 Jun 15 15:05:59.655298 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 570/1138] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:59 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:59.780331 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:05:59.780759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:05:59.781237 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:05:59.781646 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:05:59.782053 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:05:59.790880 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:59.791289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:59.792076 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:59.792533 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:59.808764 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:05:59.812812 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:05:59.823519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:05:59.826309 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:05:59.984506 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fce0c05b-4728-47a1-9371-03b6cf7c4b14 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.794770 Jun 15 15:05:59.985457 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 569/1139] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:05:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:06:00.001033 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3c6bb2c2-3c29-468b-bd44-86d84e80d806 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:00.003659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3c6bb2c2-3c29-468b-bd44-86d84e80d806 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:00.062124 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-3c6bb2c2-3c29-468b-bd44-86d84e80d806 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:00.068915 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3c6bb2c2-3c29-468b-bd44-86d84e80d806 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1242 microversion: 2.1 time: 0.074525 Jun 15 15:06:00.069484 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 571/1140] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:59 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:00.672225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:00.672882 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:00.679094 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:00.679545 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:00.680334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:00.680769 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:00.820424 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:00.830696 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3ef85ee4-77d6-444c-8b58-c704384a7e5c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.163204 Jun 15 15:06:00.831285 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 570/1141] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:00 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:01.086444 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:01.087010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:01.093530 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:01.094482 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:01.095013 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:01.095453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:01.161232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:01.168767 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bda80d98-9a97-4c03-8993-6097cd00b053 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1246 microversion: 2.1 time: 0.086290 Jun 15 15:06:01.169343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 572/1142] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:01 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:01.848441 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:01.848990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:01.855730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:01.856211 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:01.857068 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:01.857507 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:01.991962 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:02.000022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-50c2bffd-1de5-4465-ba3f-8b6b60da77f1 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1319 microversion: 2.1 time: 0.156132 Jun 15 15:06:02.000621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 571/1143] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:01 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:02.185386 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:02.186005 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:02.193094 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:02.193545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:02.194316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:02.194754 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:02.263075 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:02.270931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-85e3d12b-648f-4870-82a1-94715cc7d4d4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1294 microversion: 2.1 time: 0.089452 Jun 15 15:06:02.271501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 573/1144] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:02 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:03.017059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:03.017682 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:03.024289 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:03.024739 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:03.025520 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:03.025958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:03.166639 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:03.174752 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-633a59d2-d2c8-4d02-83e4-f3312d110002 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1508 microversion: 2.1 time: 0.161676 Jun 15 15:06:03.175364 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 572/1145] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:03 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:03.191980 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-98fea3c4-a1af-427c-9cb9-890ff5098402 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a34baed2-8227-4842-ade0-7c051c14b9aa", "device": "/dev/sdb"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:03.193667 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-98fea3c4-a1af-427c-9cb9-890ff5098402 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:03.200320 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98fea3c4-a1af-427c-9cb9-890ff5098402 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:03.200776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98fea3c4-a1af-427c-9cb9-890ff5098402 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:03.201556 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98fea3c4-a1af-427c-9cb9-890ff5098402 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:03.201997 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-98fea3c4-a1af-427c-9cb9-890ff5098402 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:03.289660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:03.290778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:03.297745 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:03.298201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:03.299134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:03.299602 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:03.369100 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:03.382879 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5976ac8c-ea4d-43f5-b3d9-574f47c866ec tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1300 microversion: 2.1 time: 0.097265 Jun 15 15:06:03.383473 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 573/1146] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:03 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:06:03.810534 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:03.999855 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-98fea3c4-a1af-427c-9cb9-890ff5098402 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "POST /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812186 Jun 15 15:06:04.000542 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 574/1147] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:06:03 2022] POST /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:04.401494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:04.407434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:04.409841 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:04.410299 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:04.411071 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:04.411512 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:04.572747 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:04.580642 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7884e377-170a-4d91-a20f-bf0460eb0d85 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.183234 Jun 15 15:06:04.581222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 574/1148] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:04 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:04.626445 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-8bed6cc7-a5f9-48a3-8872-34c88d147493 req-23f92632-3894-4a03-a4d3-2a8041f0b16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c0ee09-8208-4109-a310-0de171036e81", "tag": "0c5c178e-7a34-4d70-b26e-f92e4b0ead23"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:04.641333 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-8bed6cc7-a5f9-48a3-8872-34c88d147493 req-23f92632-3894-4a03-a4d3-2a8041f0b16d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:04.642016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-8bed6cc7-a5f9-48a3-8872-34c88d147493 req-23f92632-3894-4a03-a4d3-2a8041f0b16d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:04.654765 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-8bed6cc7-a5f9-48a3-8872-34c88d147493 req-23f92632-3894-4a03-a4d3-2a8041f0b16d service nova] Creating event network-changed:0c5c178e-7a34-4d70-b26e-f92e4b0ead23 for instance 11c0ee09-8208-4109-a310-0de171036e81 on hv-cinder-78729 Jun 15 15:06:04.660698 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-8bed6cc7-a5f9-48a3-8872-34c88d147493 req-23f92632-3894-4a03-a4d3-2a8041f0b16d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126820 Jun 15 15:06:04.661651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 575/1149] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:05.598224 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:05.598828 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:05.605563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:05.606649 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:05.606777 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:05.607181 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:05.754262 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:05.762180 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-211b7d32-8f98-4fcf-b3ee-7d67074005c2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.168372 Jun 15 15:06:05.768478 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 575/1150] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:05 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:06.779497 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:06.780220 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:06.786967 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:06.787409 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:06.788203 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:06.788634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:06.921179 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:06.929829 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-bc633bbc-4691-4a65-adb3-ab8318f629bc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.155100 Jun 15 15:06:06.930450 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 576/1151] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:06 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:07.947200 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:07.947825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:07.954940 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:07.955397 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:07.956202 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:07.956639 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:07.960668 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=100 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:08.097010 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:08.105025 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f3a3ef58-b3ff-4acb-8dea-a0c2b1a25a62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.161899 Jun 15 15:06:08.106189 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 576/1152] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:07 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:09.123238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:09.123852 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:09.131438 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:09.131883 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:09.132671 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:09.133169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:09.273677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:09.281243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-33acfc13-9107-4950-b648-f65fb038a2cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.162630 Jun 15 15:06:09.282208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 577/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:09 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:10.298621 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:10.299239 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:10.301553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:10.302222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:10.307218 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:10.307673 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:10.308488 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:10.308921 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:10.444322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:10.451744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a7fca3c5-cf75-4c50-8762-8546ac7b7817 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.156995 Jun 15 15:06:10.452334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 577/1154] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:10 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:11.265413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-b1465bdd-95e3-479a-a31d-37a6881b2dda req-052409bb-b736-47f4-ac87-6457c0493d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c0ee09-8208-4109-a310-0de171036e81", "name": "network-vif-plugged", "status": "completed", "tag": "0c5c178e-7a34-4d70-b26e-f92e4b0ead23"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:11.273119 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:11.274922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b1465bdd-95e3-479a-a31d-37a6881b2dda req-052409bb-b736-47f4-ac87-6457c0493d44 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:11.275360 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b1465bdd-95e3-479a-a31d-37a6881b2dda req-052409bb-b736-47f4-ac87-6457c0493d44 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:11.287018 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-b1465bdd-95e3-479a-a31d-37a6881b2dda req-052409bb-b736-47f4-ac87-6457c0493d44 service nova] Creating event network-vif-plugged:0c5c178e-7a34-4d70-b26e-f92e4b0ead23 for instance 11c0ee09-8208-4109-a310-0de171036e81 on hv-cinder-78729 Jun 15 15:06:11.291976 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-b1465bdd-95e3-479a-a31d-37a6881b2dda req-052409bb-b736-47f4-ac87-6457c0493d44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030497 Jun 15 15:06:11.292593 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 578/1155] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:11.470775 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:11.471403 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:11.477994 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:11.478446 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:11.479219 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:11.479679 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:11.617903 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:11.626777 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-73d72f82-b2c4-4678-a158-798e9fb4fb5e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.160804 Jun 15 15:06:11.627663 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 578/1156] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:11 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:12.645789 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:12.646512 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:12.652714 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:12.653160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:12.653944 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:12.654376 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:12.786285 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:12.793995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e491c81d-b261-43e0-8878-339b23d947a9 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.153542 Jun 15 15:06:12.794551 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 579/1157] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:12 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:13.814022 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:13.814911 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:13.821816 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:13.823718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:13.823718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:13.823718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:13.957708 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:13.965222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-777178b5-79c5-494b-8f0f-0e6ff659549c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1368 microversion: 2.1 time: 0.155210 Jun 15 15:06:13.965786 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 579/1158] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:13 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:14.982575 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:14.983180 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:14.990426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:14.990869 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:14.991622 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:14.992052 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:15.128258 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:15.135793 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e45f55d1-3911-4c1f-88cd-f9fc846a881a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1557 microversion: 2.1 time: 0.157090 Jun 15 15:06:15.136393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 580/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:14 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:15.154896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9ea82000-ae48-412a-9622-fe0292f07230 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:15.155406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9ea82000-ae48-412a-9622-fe0292f07230 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:15.162408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ea82000-ae48-412a-9622-fe0292f07230 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:15.162931 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ea82000-ae48-412a-9622-fe0292f07230 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:15.163763 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ea82000-ae48-412a-9622-fe0292f07230 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:15.164306 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9ea82000-ae48-412a-9622-fe0292f07230 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:15.245776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9ea82000-ae48-412a-9622-fe0292f07230 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094651 Jun 15 15:06:15.246778 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 580/1160] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 15:06:15 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:16.465777 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-73980ae1-250a-4310-a90f-f73a356b80ac req-f04cc7b5-aabf-4968-9f85-5d0da466c783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c0ee09-8208-4109-a310-0de171036e81", "tag": "0c5c178e-7a34-4d70-b26e-f92e4b0ead23"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:16.474511 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-73980ae1-250a-4310-a90f-f73a356b80ac req-f04cc7b5-aabf-4968-9f85-5d0da466c783 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:16.474981 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-73980ae1-250a-4310-a90f-f73a356b80ac req-f04cc7b5-aabf-4968-9f85-5d0da466c783 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:16.485854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-73980ae1-250a-4310-a90f-f73a356b80ac req-f04cc7b5-aabf-4968-9f85-5d0da466c783 service nova] Creating event network-changed:0c5c178e-7a34-4d70-b26e-f92e4b0ead23 for instance 11c0ee09-8208-4109-a310-0de171036e81 on hv-cinder-78729 Jun 15 15:06:16.491192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-73980ae1-250a-4310-a90f-f73a356b80ac req-f04cc7b5-aabf-4968-9f85-5d0da466c783 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029155 Jun 15 15:06:16.491836 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 581/1161] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:27.237837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:06:27.238453 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 15:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:06:32.267119 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:32.267877 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=26 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:32.272293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:32.272798 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:32.278765 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:32.279225 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:32.279996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:32.280485 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:32.360633 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lazy-loading 'services' on Instance uuid 61292e0f-c494-49da-ad70-9a5bc5103952 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:06:32.603710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-78e2a6d7-1cde-4d53-a47b-02551fbbf28c tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "DELETE /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952/os-volume_attachments/a34baed2-8227-4842-ade0-7c051c14b9aa" status: 202 len: 0 microversion: 2.1 time: 0.337788 Jun 15 15:06:32.604390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 581/1162] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 15:06:32 2022] DELETE /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952/os-volume_attachments/a34baed2-8227-4842-ade0-7c051c14b9aa => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:06:34.775994 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:34.776615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:34.779173 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:34.779820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:34.784907 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:34.785346 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:34.791140 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:34.791140 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:34.814037 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:06:35.095557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-946732a1-89ce-4869-ade9-b712c4e2c2e2 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "DELETE /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 204 len: 0 microversion: 2.1 time: 0.323442 Jun 15 15:06:35.096073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 582/1163] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:06:34 2022] DELETE /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:06:35.105750 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:35.106838 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:35.113447 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:35.117434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:35.117434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:35.117434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:35.245898 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:35.253902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-44bb6eae-692e-4206-9ab0-caa4b3f3cb90 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1514 microversion: 2.1 time: 0.152451 Jun 15 15:06:35.254489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 582/1164] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:35 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:36.271462 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:36.272184 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:36.278610 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:36.279053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:36.279815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:36.280279 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:36.408917 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:36.416618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-04a7a174-fdd2-469e-8c8e-a928dd71e8ff tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1514 microversion: 2.1 time: 0.149506 Jun 15 15:06:36.417192 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 583/1165] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:36 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:37.434422 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:37.435023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:37.442059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:37.442510 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:37.443281 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:37.443719 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:37.574014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:37.582254 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-8723b69c-7574-4eb2-b1d2-35f1f7ea029a tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1514 microversion: 2.1 time: 0.151755 Jun 15 15:06:37.583038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 583/1166] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:37 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:37.938953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-137233c8-10c0-4652-8613-52b1e2e2066e req-551eae4f-9fe2-41c4-8ef9-396eca082df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61292e0f-c494-49da-ad70-9a5bc5103952", "name": "network-vif-deleted", "tag": "6f029218-c947-4f38-8be5-36724ad44714"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:37.948820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-137233c8-10c0-4652-8613-52b1e2e2066e req-551eae4f-9fe2-41c4-8ef9-396eca082df4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:37.949270 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-137233c8-10c0-4652-8613-52b1e2e2066e req-551eae4f-9fe2-41c4-8ef9-396eca082df4 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:37.960357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-137233c8-10c0-4652-8613-52b1e2e2066e req-551eae4f-9fe2-41c4-8ef9-396eca082df4 service nova] Creating event network-vif-deleted:6f029218-c947-4f38-8be5-36724ad44714 for instance 61292e0f-c494-49da-ad70-9a5bc5103952 on hv-cinder-78729 Jun 15 15:06:37.965187 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-137233c8-10c0-4652-8613-52b1e2e2066e req-551eae4f-9fe2-41c4-8ef9-396eca082df4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029904 Jun 15 15:06:37.965776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 584/1167] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:38.599302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:38.601504 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:38.606543 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:38.606999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:38.607877 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:38.608345 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:38.639424 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:38.639855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:38.640343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lazy-loading 'fault' on Instance uuid 61292e0f-c494-49da-ad70-9a5bc5103952 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:06:38.684635 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae775f33122c48fabd917accd0e6cb16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efcbca3db4f49c6a11803516941ebe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:38.692150 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e484ff4d-ec1a-406d-95eb-31332408b8aa tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 200 len: 1309 microversion: 2.1 time: 0.097427 Jun 15 15:06:38.692711 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 584/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:38 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:39.710783 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:39.711627 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] [instance: 61292e0f-c494-49da-ad70-9a5bc5103952] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:39.717841 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:39.718291 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:39.719052 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:39.719491 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:39.733001 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] HTTP exception thrown: Instance 61292e0f-c494-49da-ad70-9a5bc5103952 could not be found. Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Request method failure captured: Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 HTTP/1.1 Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfTqdusDra8P5O2aSGT4Oud5R0-AON91I-rsjszCGUFyzVacrK61NsDEVFqMxw1DS7CNpT6ifXWqxq1dkyDWur7E5_4vxV9X6uyeTo5NGB6-15W46qjai4wklHRTjiRBJ4wsPTCgsdWrEGoo7hFpD4DtCBLfn-rCOPD-W1JxtOID-AY Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 3efcbca3db4f49c6a11803516941ebe1 Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-VolumesSnapshotTestJSON-404446456 Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:06:39.734595 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3efcbca3db4f49c6a11803516941ebe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-VolumesSnapshotTestJSON-404446456 Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 3efcbca3db4f49c6a11803516941ebe1 Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-404446456 Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-VolumesSnapshotTestJSON-404446456-project Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: ae775f33122c48fabd917accd0e6cb16 Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-VolumesSnapshotTestJSON-404446456-project Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 61292e0f-c494-49da-ad70-9a5bc5103952 could not be found. Jun 15 15:06:39.736132 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '61292e0f-c494-49da-ad70-9a5bc5103952'} Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61292e0f-c494-49da-ad70-9a5bc5103952 could not be found. Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:06:39.736952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61292e0f-c494-49da-ad70-9a5bc5103952 could not be found. Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61292e0f-c494-49da-ad70-9a5bc5103952 could not be found. Jun 15 15:06:39.739224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:06:39.740816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] Returning 404 to user: Instance 61292e0f-c494-49da-ad70-9a5bc5103952 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:06:39.740816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c848a43e-2d5e-482c-be17-46ce611e3f91 tempest-VolumesSnapshotTestJSON-404446456 tempest-VolumesSnapshotTestJSON-404446456-project] 10.222.0.42 "GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952" status: 404 len: 111 microversion: 2.1 time: 0.029969 Jun 15 15:06:39.740816 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 585/1169] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:39 2022] GET /compute/v2.1/servers/61292e0f-c494-49da-ad70-9a5bc5103952 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:08:01.980417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=10 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:01.981179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:01.985138 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a0773336-c067-4d8d-b237-06b06c7fa425 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:01.989902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a0773336-c067-4d8d-b237-06b06c7fa425 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:01.991610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0773336-c067-4d8d-b237-06b06c7fa425 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:01.992056 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0773336-c067-4d8d-b237-06b06c7fa425 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:01.992861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0773336-c067-4d8d-b237-06b06c7fa425 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:01.993302 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a0773336-c067-4d8d-b237-06b06c7fa425 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:02.018550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a0773336-c067-4d8d-b237-06b06c7fa425 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81/ips" status: 200 len: 149 microversion: 2.1 time: 0.039930 Jun 15 15:08:02.019143 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 585/1170] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 15:08:01 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:02.027626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:02.028422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:02.032618 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b0c0d27-a558-4a1e-8715-c829c87a0ed7"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:02.033678 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:02.039768 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:02.040250 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:02.041009 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:02.041539 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:02.123027 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Invalid volume: volume 1b0c0d27-a558-4a1e-8715-c829c87a0ed7 is already attached to instances: 7fef7f2a-f9c1-4903-a741-91693d3e88da Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: POST /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81/os-volume_attachments HTTP/1.1 Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 74 Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:08:02.125338 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {"volumeAttachment": {"volumeId": "1b0c0d27-a558-4a1e-8715-c829c87a0ed7"}} Jun 15 15:08:02.130730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Invalid volume: volume 1b0c0d27-a558-4a1e-8715-c829c87a0ed7 is already attached to instances: 7fef7f2a-f9c1-4903-a741-91693d3e88da Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'server_id': '11c0ee09-8208-4109-a310-0de171036e81', 'body': {'volumeAttachment': {'volumeId': '1b0c0d27-a558-4a1e-8715-c829c87a0ed7'}}} Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1b0c0d27-a558-4a1e-8715-c829c87a0ed7 is already attached to instances: 7fef7f2a-f9c1-4903-a741-91693d3e88da Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:02.131659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1b0c0d27-a558-4a1e-8715-c829c87a0ed7 is already attached to instances: 7fef7f2a-f9c1-4903-a741-91693d3e88da Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:02.133194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1b0c0d27-a558-4a1e-8715-c829c87a0ed7 is already attached to instances: 7fef7f2a-f9c1-4903-a741-91693d3e88da Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 400 to user: Invalid volume: volume 1b0c0d27-a558-4a1e-8715-c829c87a0ed7 is already attached to instances: 7fef7f2a-f9c1-4903-a741-91693d3e88da {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-254b68ea-085c-46bd-82c4-fabdb5710623 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101177 Jun 15 15:08:02.134718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 586/1171] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:08:02 2022] POST /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:08:02.135825 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:02.136365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:02.143015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:02.143474 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:02.144370 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:02.144730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:02.172598 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Going to try to terminate instance {{(pid=124660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:08:02.502864 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e1dcc03c-12d6-4f85-a339-f27293849c3d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 204 len: 0 microversion: 2.1 time: 0.370524 Jun 15 15:08:02.503747 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 586/1172] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:08:02 2022] DELETE /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:08:02.517169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:02.517792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:02.526280 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:02.526894 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:02.527488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:02.527950 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:02.662285 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:02.669839 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-895d4d08-2ab1-470b-9921-fe00379ec9aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1682 microversion: 2.1 time: 0.160122 Jun 15 15:08:02.670358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 587/1173] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:02 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:03.690180 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:03.690872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:03.697660 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:03.698107 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:03.698865 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:03.699298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:03.830450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:03.837909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e1248d55-686b-4c21-989d-ee55cde10d47 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1682 microversion: 2.1 time: 0.152665 Jun 15 15:08:03.838467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 587/1174] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:03 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:04.855190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:04.855918 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:04.863449 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:04.863894 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:04.864791 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:04.865232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:04.997585 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:05.005634 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f033cb57-81ea-402f-87a7-5a8617cd8384 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1682 microversion: 2.1 time: 0.154658 Jun 15 15:08:05.013823 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 588/1175] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:04 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:05.302861 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-27617a68-7b5f-4d01-98f8-0ab9ba3205e0 req-1e6025cb-41c3-4de3-8b43-708f9deea07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c0ee09-8208-4109-a310-0de171036e81", "name": "network-vif-deleted", "tag": "0c5c178e-7a34-4d70-b26e-f92e4b0ead23"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:05.311922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-27617a68-7b5f-4d01-98f8-0ab9ba3205e0 req-1e6025cb-41c3-4de3-8b43-708f9deea07d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:05.312434 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-27617a68-7b5f-4d01-98f8-0ab9ba3205e0 req-1e6025cb-41c3-4de3-8b43-708f9deea07d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:05.324222 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-27617a68-7b5f-4d01-98f8-0ab9ba3205e0 req-1e6025cb-41c3-4de3-8b43-708f9deea07d service nova] Creating event network-vif-deleted:0c5c178e-7a34-4d70-b26e-f92e4b0ead23 for instance 11c0ee09-8208-4109-a310-0de171036e81 on hv-cinder-78729 Jun 15 15:08:05.330343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-27617a68-7b5f-4d01-98f8-0ab9ba3205e0 req-1e6025cb-41c3-4de3-8b43-708f9deea07d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031489 Jun 15 15:08:05.330948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 588/1176] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:06.023061 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:06.023674 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:06.031015 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:06.033413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:06.033413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:06.033413 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:06.070057 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:06.070506 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:06.071261 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lazy-loading 'fault' on Instance uuid 11c0ee09-8208-4109-a310-0de171036e81 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:08:06.113722 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:06.120892 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-81c86302-2c9d-45c8-8bdd-684fa3c6c419 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 200 len: 1332 microversion: 2.1 time: 0.101416 Jun 15 15:08:06.121684 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 589/1177] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:06 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:07.141917 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:07.142677 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:07.150412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:07.151772 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:07.153990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:07.154463 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:07.169362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 HTTP/1.1 Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:08:07.171683 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:08:07.173492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '11c0ee09-8208-4109-a310-0de171036e81'} Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:08:07.174448 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:08:07.176027 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:08:07.177782 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:08:07.177782 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5542cdc3-e720-456d-b14e-98a47dd7223e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 404 len: 111 microversion: 2.1 time: 0.036426 Jun 15 15:08:07.177782 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 589/1178] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:07 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:08:07.182134 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-819aa0df-4b93-4366-8e42-d8689a1bcd75 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '.version_select at 0x7fb8acb183a0>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:07.263019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-819aa0df-4b93-4366-8e42-d8689a1bcd75 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180971094" status: 202 len: 0 microversion: 2.1 time: 0.083709 Jun 15 15:08:07.263019 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 590/1179] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jun 15 15:08:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180971094 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:08:08.113385 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:08.114057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:08.120542 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:08.120996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:08.121830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:08.122272 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:08.210749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lazy-loading 'services' on Instance uuid 7fef7f2a-f9c1-4903-a741-91693d3e88da {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:08:08.437955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-098e9839-671e-4201-bb3b-407688b969fc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments/1b0c0d27-a558-4a1e-8715-c829c87a0ed7" status: 202 len: 0 microversion: 2.1 time: 0.328733 Jun 15 15:08:08.438558 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 590/1180] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 15:08:08 2022] DELETE /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments/1b0c0d27-a558-4a1e-8715-c829c87a0ed7 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:08:08.447707 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f4f21b19-8ebb-4583-9576-5b9b23102f72 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:08.448733 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f4f21b19-8ebb-4583-9576-5b9b23102f72 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:08.456209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4f21b19-8ebb-4583-9576-5b9b23102f72 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:08.456654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4f21b19-8ebb-4583-9576-5b9b23102f72 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:08.457423 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4f21b19-8ebb-4583-9576-5b9b23102f72 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:08.457851 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f4f21b19-8ebb-4583-9576-5b9b23102f72 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:08.487366 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f4f21b19-8ebb-4583-9576-5b9b23102f72 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Jun 15 15:08:08.487837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 591/1181] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:08:08 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:09.501061 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-025b2956-9722-4e43-a239-2a0a0aa17024 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:09.502074 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-025b2956-9722-4e43-a239-2a0a0aa17024 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:09.508382 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-025b2956-9722-4e43-a239-2a0a0aa17024 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:09.508837 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-025b2956-9722-4e43-a239-2a0a0aa17024 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:09.509608 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-025b2956-9722-4e43-a239-2a0a0aa17024 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:09.510050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-025b2956-9722-4e43-a239-2a0a0aa17024 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:09.539916 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-025b2956-9722-4e43-a239-2a0a0aa17024 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Jun 15 15:08:09.540514 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 591/1182] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:08:09 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:10.551531 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-737d2078-538c-445b-8b11-abd6fc859508 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:10.552591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-737d2078-538c-445b-8b11-abd6fc859508 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:10.559300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-737d2078-538c-445b-8b11-abd6fc859508 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:10.559752 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-737d2078-538c-445b-8b11-abd6fc859508 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:10.560550 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-737d2078-538c-445b-8b11-abd6fc859508 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:10.560986 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-737d2078-538c-445b-8b11-abd6fc859508 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:10.589087 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-737d2078-538c-445b-8b11-abd6fc859508 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041473 Jun 15 15:08:10.589641 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 592/1183] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:08:10 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:08:10.646169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:10.646680 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:10.653482 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:10.654040 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:10.654803 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:10.655241 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:10.680546 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Going to try to terminate instance {{(pid=124660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:08:10.906463 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-64a6843d-e14f-441e-bfb1-1b73d0dcbb62 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 204 len: 0 microversion: 2.1 time: 0.263739 Jun 15 15:08:10.906997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 592/1184] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:08:10 2022] DELETE /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:08:10.915146 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:10.915788 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:10.922013 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:10.922461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:10.923222 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:10.923656 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:11.057208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:11.065801 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-22a4cfa8-7c81-4688-97d1-82f076a21cf1 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1680 microversion: 2.1 time: 0.154536 Jun 15 15:08:11.066384 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 593/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:10 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:12.083996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:12.084802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:12.091961 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:12.092226 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:12.093893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:12.094605 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:12.231629 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:12.239798 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2c16cc44-4576-4a86-be49-02ae643496c4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1680 microversion: 2.1 time: 0.160137 Jun 15 15:08:12.240410 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 593/1186] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:12 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:13.257109 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:13.257725 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:13.264296 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:13.264794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:13.265552 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:13.265988 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:13.397206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:13.404679 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2268bf49-a749-4e82-92ad-d1212e14c647 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1680 microversion: 2.1 time: 0.151403 Jun 15 15:08:13.405876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 594/1187] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:13 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:14.423395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:14.423942 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:14.430702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:14.431143 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:14.431901 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:14.432366 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:14.560993 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:14.569091 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e3fd516b-1360-4445-a292-9a0c88f329b6 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1680 microversion: 2.1 time: 0.150578 Jun 15 15:08:14.569652 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 594/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:14 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:15.585676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:15.586291 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:15.592877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:15.598391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:15.598391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:15.598391 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:15.722502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:15.730121 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7d9f6a25-1009-4372-a7ff-f695098bf91a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1680 microversion: 2.1 time: 0.148377 Jun 15 15:08:15.730687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 595/1189] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:15 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:16.749975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:16.750706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:16.757306 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:16.757761 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:16.758544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:16.758990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:16.902065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:16.909870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7697272b-a843-480c-b889-56c4a5b5a7b2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1680 microversion: 2.1 time: 0.165114 Jun 15 15:08:16.910439 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 595/1190] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:16 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:17.301673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-b27462a5-9565-4ae6-b727-c74e3f015890 req-724e1627-f454-4b7e-8614-42abc74219b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fef7f2a-f9c1-4903-a741-91693d3e88da", "name": "network-vif-deleted", "tag": "9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:17.312510 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b27462a5-9565-4ae6-b727-c74e3f015890 req-724e1627-f454-4b7e-8614-42abc74219b5 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:17.313253 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-b27462a5-9565-4ae6-b727-c74e3f015890 req-724e1627-f454-4b7e-8614-42abc74219b5 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:17.326591 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-b27462a5-9565-4ae6-b727-c74e3f015890 req-724e1627-f454-4b7e-8614-42abc74219b5 service nova] Creating event network-vif-deleted:9cdc7c13-cc3c-4c3d-8a0d-4f1ef7f3bdde for instance 7fef7f2a-f9c1-4903-a741-91693d3e88da on hv-cinder-78729 Jun 15 15:08:17.335898 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-b27462a5-9565-4ae6-b727-c74e3f015890 req-724e1627-f454-4b7e-8614-42abc74219b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038170 Jun 15 15:08:17.336537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 596/1191] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:08:17.927870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:17.928550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:17.936118 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:17.937242 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:17.938025 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:17.938576 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:17.973842 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:17.974724 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:17.975978 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lazy-loading 'fault' on Instance uuid 7fef7f2a-f9c1-4903-a741-91693d3e88da {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:08:18.031482 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:18.045236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f50fa1a2-0285-4316-92ea-c185bc653ab2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 200 len: 1330 microversion: 2.1 time: 0.116056 Jun 15 15:08:18.045236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 596/1192] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:17 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:19.063529 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:19.064295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:19.071758 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:19.072242 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:19.073016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:19.073453 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:19.087663 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da HTTP/1.1 Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:08:19.089342 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:08:19.090876 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '7fef7f2a-f9c1-4903-a741-91693d3e88da'} Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:08:19.092160 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:08:19.093558 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:08:19.095297 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:08:19.095297 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8c85eb0b-ef84-406d-9b6c-9c4d68a021d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 404 len: 111 microversion: 2.1 time: 0.032604 Jun 15 15:08:19.095297 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 597/1193] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:19 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:08:19.100643 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5b4a34bb-5473-4227-855e-f4d0327fffea tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '.version_select at 0x7fb8a8163b80>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:19.180371 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5b4a34bb-5473-4227-855e-f4d0327fffea tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655622217" status: 202 len: 0 microversion: 2.1 time: 0.083509 Jun 15 15:08:19.180952 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 597/1194] 10.222.0.42 () {58 vars in 1217 bytes} [Wed Jun 15 15:08:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655622217 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:08:19.972418 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8d8d6245-f272-48cf-8237-df88326f3bf2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: .version_select at 0x7fb8a85145e0>, body: {"keypair": {"name": "tempest-keypair-2124253051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXtigVnvNjNONE1cppC0VjUewDm2uhej5z6JfusevMGEmau+hLkZX9e3Xy1rWxuwTEFjk607qX2OuHw6z7jP6NCPTaMy8kWAoRqOWOGN0B2v6QW2vno7zkWUclZZR1g1Q=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:19.986071 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-8d8d6245-f272-48cf-8237-df88326f3bf2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:08:19.989808 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-8d8d6245-f272-48cf-8237-df88326f3bf2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:08:20.074030 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8d8d6245-f272-48cf-8237-df88326f3bf2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105498 Jun 15 15:08:20.074688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 598/1195] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 15:08:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:22.360849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-982228040", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "115a225d-97b8-4fa4-b2b8-ad448d4e5db3"}], "security_groups": [{"name": "tempest-securitygroup--1270276273"}], "key_name": "tempest-keypair-2124253051", "user_data": "}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:22.465919 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] validate_networks() for [('115a225d-97b8-4fa4-b2b8-ad448d4e5db3', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:08:22.841554 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:08:22.841982 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:08:22.842947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:08:22.843365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:08:22.843770 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:08:22.852935 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:22.853379 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:22.854174 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:22.854609 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:22.872386 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:08:22.876336 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:08:22.887466 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:08:22.890298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:08:23.031850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-37063635-f4c7-41cc-b221-e3199bf1932a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.676399 Jun 15 15:08:23.032536 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 598/1196] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:08:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:08:23.043293 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7041d035-1c55-4b61-a681-5634460aa507 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:23.044597 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7041d035-1c55-4b61-a681-5634460aa507 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:23.102936 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7041d035-1c55-4b61-a681-5634460aa507 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:23.110208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7041d035-1c55-4b61-a681-5634460aa507 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1241 microversion: 2.1 time: 0.071280 Jun 15 15:08:23.113395 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 599/1197] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:23 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:24.127689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1c28ea2e-b40b-4fe9-8852-c557e4c513e8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:24.128355 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1c28ea2e-b40b-4fe9-8852-c557e4c513e8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:24.182272 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1c28ea2e-b40b-4fe9-8852-c557e4c513e8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:24.189611 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1c28ea2e-b40b-4fe9-8852-c557e4c513e8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1241 microversion: 2.1 time: 0.066619 Jun 15 15:08:24.190183 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 599/1198] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:24 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:24.430012 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2105527953", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-993253485", "security_groups": [{"name": "tempest-secgroup-smoke-693886938"}], "block_device_mapping_v2": [{"uuid": "18d08cb4-26a0-42e0-8d7e-2929a1c23023", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae29f25b-1566-4281-8605-e2a4f3901460"}]}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:24.539719 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.network.neutron [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] validate_networks() for [('ae29f25b-1566-4281-8605-e2a4f3901460', None, None, None, None, None)] {{(pid=124659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:08:24.912012 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Flavor limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:08:24.912477 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Image limits 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:08:24.912958 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Flavor pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:08:24.913379 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Image pref 0:0:0 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:08:24.913820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.virt.hardware [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:08:24.923046 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:24.923495 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:24.924343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:24.924784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:24.942152 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:08:24.946133 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Getting quotas for user e209ae2f7fa7412b95c7c43c74c14426 and project 79f361ea99aa45c185d50d83c84e5dc1. Resources: {'instances', 'ram', 'cores'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:08:25.008274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Going to run 1 instances... {{(pid=124659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:08:25.008799 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18d08cb4-26a0-42e0-8d7e-2929a1c23023',volume_size=None,volume_type=None)] {{(pid=124659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:08:25.208948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-576e1c2b-b351-42cf-b417-4d0928fa691b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:25.208948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-576e1c2b-b351-42cf-b417-4d0928fa691b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:25.264785 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-576e1c2b-b351-42cf-b417-4d0928fa691b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:25.271543 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-576e1c2b-b351-42cf-b417-4d0928fa691b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1241 microversion: 2.1 time: 0.067877 Jun 15 15:08:25.272145 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 600/1199] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:25 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:25.371790 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f02d4c11-b998-4cce-800a-b8916e996cc1 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.945607 Jun 15 15:08:25.372486 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 600/1200] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:08:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:08:25.383508 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a66e6d2c-4428-40df-88cd-2405e881d6a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:25.384207 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a66e6d2c-4428-40df-88cd-2405e881d6a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:25.443522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-a66e6d2c-4428-40df-88cd-2405e881d6a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:25.450516 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a66e6d2c-4428-40df-88cd-2405e881d6a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1094 microversion: 2.1 time: 0.070976 Jun 15 15:08:25.451080 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 601/1201] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:25 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:26.408238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-47aa4f16-029a-4bc2-88af-bff92658321b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:26.408238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-47aa4f16-029a-4bc2-88af-bff92658321b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:26.462925 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-47aa4f16-029a-4bc2-88af-bff92658321b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:26.469791 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bd706946-67c2-4bd1-9996-4531e94008a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:26.471615 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bd706946-67c2-4bd1-9996-4531e94008a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:26.472131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-47aa4f16-029a-4bc2-88af-bff92658321b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1241 microversion: 2.1 time: 0.186993 Jun 15 15:08:26.481773 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 601/1202] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:26 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:26.532006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bd706946-67c2-4bd1-9996-4531e94008a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:26.541851 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bd706946-67c2-4bd1-9996-4531e94008a4 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1094 microversion: 2.1 time: 0.077252 Jun 15 15:08:26.543047 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 602/1203] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:26 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:27.489912 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:27.490527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:27.497011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:27.497465 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:27.498224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:27.499330 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:27.560345 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2fd26dac-38d9-4bd4-b3f3-0c4eee108e1b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:27.560811 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:27.562601 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2fd26dac-38d9-4bd4-b3f3-0c4eee108e1b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:27.568779 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e9a083d7-b2dd-4fc0-aa8d-ec8730d26f25 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1245 microversion: 2.1 time: 0.082930 Jun 15 15:08:27.577077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 602/1204] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:27 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:27.626429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-2fd26dac-38d9-4bd4-b3f3-0c4eee108e1b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:27.633165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2fd26dac-38d9-4bd4-b3f3-0c4eee108e1b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1094 microversion: 2.1 time: 0.077446 Jun 15 15:08:27.637344 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 603/1205] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:27 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:28.586049 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:28.586649 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:28.593090 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:28.596902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:28.596902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:28.596902 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:28.650664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-86015b24-231e-4490-a7c7-ff244bcda458 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:28.651290 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-86015b24-231e-4490-a7c7-ff244bcda458 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:28.656537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:28.664154 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f857981e-af7f-4810-a5d8-5ecdf011d587 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1293 microversion: 2.1 time: 0.082037 Jun 15 15:08:28.664922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 603/1206] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:28 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:28.705698 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-86015b24-231e-4490-a7c7-ff244bcda458 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:28.712730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-86015b24-231e-4490-a7c7-ff244bcda458 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1094 microversion: 2.1 time: 0.066079 Jun 15 15:08:28.713293 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 604/1207] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:28 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:29.681122 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:29.681905 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:29.689364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:29.689812 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:29.690648 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:29.691169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:29.729902 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:29.731718 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:29.739408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:29.740144 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:29.740925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:29.741359 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:29.754870 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:29.762446 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f2cb3722-3ddb-45ec-929b-8129091cd4cf tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1299 microversion: 2.1 time: 0.085117 Jun 15 15:08:29.763022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 604/1208] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:29 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:29.808166 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:29.815971 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5f0e3de8-b46c-4db9-8336-be463931c012 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1144 microversion: 2.1 time: 0.090496 Jun 15 15:08:29.816575 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 605/1209] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:29 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:30.781399 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:30.782043 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:30.788828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:30.789286 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:30.790082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:30.790526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:30.838009 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:30.847048 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:30.856626 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:30.857642 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:30.859835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:30.860563 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:30.886613 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:30.943459 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:30.951201 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6dca65d4-1e7c-40d6-a642-75bc8c847b28 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1192 microversion: 2.1 time: 0.121228 Jun 15 15:08:30.952648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 606/1210] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:30 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:30.980375 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:30.988702 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9ab02718-54e0-45b7-b9e5-e5d94cfab810 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.212535 Jun 15 15:08:30.989367 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 605/1211] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:30 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:31.038437 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-8e793b58-ec11-4690-bf47-1c825a953cb3 req-196b6d88-f585-4435-8fe4-2d4f3351c1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcef133-6d80-4212-9289-831c557ad573", "tag": "7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:31.053995 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8e793b58-ec11-4690-bf47-1c825a953cb3 req-196b6d88-f585-4435-8fe4-2d4f3351c1e6 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:31.054441 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-8e793b58-ec11-4690-bf47-1c825a953cb3 req-196b6d88-f585-4435-8fe4-2d4f3351c1e6 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:31.068330 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-8e793b58-ec11-4690-bf47-1c825a953cb3 req-196b6d88-f585-4435-8fe4-2d4f3351c1e6 service nova] Creating event network-changed:7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e for instance bfcef133-6d80-4212-9289-831c557ad573 on hv-cinder-78729 Jun 15 15:08:31.073805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-8e793b58-ec11-4690-bf47-1c825a953cb3 req-196b6d88-f585-4435-8fe4-2d4f3351c1e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039272 Jun 15 15:08:31.074418 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 607/1212] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:31.969740 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:31.970403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:31.977448 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:31.978183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:31.978964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:31.979685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:32.006949 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:32.008408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:32.018603 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:32.024651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:32.024651 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:32.025415 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:32.025849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:32.128527 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:32.136312 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cab7f1c1-7f4b-4439-bdbe-eb86a7304d2b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1210 microversion: 2.1 time: 0.170918 Jun 15 15:08:32.136893 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 606/1213] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:31 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:32.253827 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:32.261720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-6dfe705a-c47f-4a9b-b2d7-958a606e238b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.259326 Jun 15 15:08:32.262312 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 608/1214] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:32 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:33.153908 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:33.154581 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:33.157218 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:33.162288 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:33.162733 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:33.163598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:33.164029 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:33.279047 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:33.280404 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:33.282408 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:33.288057 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:33.288614 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:33.295055 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:33.295055 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:33.304360 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:33.312369 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0d7e3377-f8f1-4124-a860-bea238e17797 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1277 microversion: 2.1 time: 0.161921 Jun 15 15:08:33.312951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 607/1215] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:33 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:33.422470 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:33.429948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-83243d8e-697a-45fb-8dac-42b2795645ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.155069 Jun 15 15:08:33.430522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 609/1216] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:33 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:34.329563 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:34.330183 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:34.337008 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:34.337460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:34.338238 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:34.338679 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:34.342922 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=100 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:34.446641 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:34.447274 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:34.454390 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:34.454849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:34.455635 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:34.456081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:34.475560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:34.483849 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c5fa0564-e355-4c66-9d3b-2a313f56dfaa tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1277 microversion: 2.1 time: 0.157951 Jun 15 15:08:34.484559 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 608/1217] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:34 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:34.618481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:34.626762 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3ac12903-bde3-44ab-9f1d-1a17faa8c650 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.184347 Jun 15 15:08:34.627381 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 610/1218] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:34 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:35.358821 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-774b5cfa-0c65-4700-ad30-633bc3048a4e req-2debc88a-473b-4547-a53d-b5b2327c4cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c621a06-3b52-4c55-b8e8-a2ac174c911d", "tag": "2ceb2088-adbb-49d7-86f9-cfc777d30afa"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:35.362444 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=2 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:35.369236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-774b5cfa-0c65-4700-ad30-633bc3048a4e req-2debc88a-473b-4547-a53d-b5b2327c4cfb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:35.369679 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-774b5cfa-0c65-4700-ad30-633bc3048a4e req-2debc88a-473b-4547-a53d-b5b2327c4cfb service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:35.382331 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-774b5cfa-0c65-4700-ad30-633bc3048a4e req-2debc88a-473b-4547-a53d-b5b2327c4cfb service nova] Creating event network-changed:2ceb2088-adbb-49d7-86f9-cfc777d30afa for instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d on hv-cinder-78729 Jun 15 15:08:35.387358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-774b5cfa-0c65-4700-ad30-633bc3048a4e req-2debc88a-473b-4547-a53d-b5b2327c4cfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034399 Jun 15 15:08:35.387965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 609/1219] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:35.501436 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:35.502055 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:35.508839 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:35.509288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:35.510088 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:35.510523 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:35.646096 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:35.646889 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:35.654524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:35.655602 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:35.656470 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:35.656914 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:35.767353 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:35.774965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e765b8d4-5bbd-4cb9-9f24-4451d60beb30 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.277483 Jun 15 15:08:35.775558 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 611/1220] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:35 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:35.855442 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:35.863557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1244fefb-d155-4797-827a-d23d114fc0f7 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.222618 Jun 15 15:08:35.864496 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 610/1221] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:35 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:36.792232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:36.792959 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:36.800767 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:36.801217 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:36.801990 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:36.802457 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:36.880968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:36.881680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:36.884350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=14 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:36.889509 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:36.897229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:36.897229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:36.897229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:36.948010 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:36.955965 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-eda60a10-0950-4b64-9025-6a82256a44eb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.167555 Jun 15 15:08:36.956713 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 612/1222] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:36 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:37.035343 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:37.042766 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-2de5361d-05e6-4750-a888-9595b695a737 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.165764 Jun 15 15:08:37.046224 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 611/1223] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:36 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:37.973867 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:37.974564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:37.981167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:37.981623 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:37.982393 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:37.982920 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:38.059623 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:38.060422 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:38.067371 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:38.067924 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:38.068809 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:38.069330 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:38.130350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:38.138490 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-77e64af1-3190-426a-9c16-33fc8bb43bb5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.169021 Jun 15 15:08:38.139921 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 613/1224] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:37 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:38.225955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:38.233726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-7fa26237-4996-4256-a957-e8aa8b3e8549 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.178169 Jun 15 15:08:38.234306 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 612/1225] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:38 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:38.257987 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-0f193055-b0a7-4fd0-bfee-16fd8b253055 req-db3d23cc-5b2f-42e5-a309-304b67b53d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcef133-6d80-4212-9289-831c557ad573", "name": "network-vif-plugged", "status": "completed", "tag": "7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:38.267511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-0f193055-b0a7-4fd0-bfee-16fd8b253055 req-db3d23cc-5b2f-42e5-a309-304b67b53d34 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:38.267511 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-0f193055-b0a7-4fd0-bfee-16fd8b253055 req-db3d23cc-5b2f-42e5-a309-304b67b53d34 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:38.278958 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-0f193055-b0a7-4fd0-bfee-16fd8b253055 req-db3d23cc-5b2f-42e5-a309-304b67b53d34 service nova] Creating event network-vif-plugged:7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e for instance bfcef133-6d80-4212-9289-831c557ad573 on hv-cinder-78729 Jun 15 15:08:38.284996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-0f193055-b0a7-4fd0-bfee-16fd8b253055 req-db3d23cc-5b2f-42e5-a309-304b67b53d34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098814 Jun 15 15:08:38.285578 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 614/1226] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:39.157083 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:39.157651 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:39.164596 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:39.165046 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:39.165818 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:39.166260 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:39.247744 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=18 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:08:39.252688 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:39.253474 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:39.260341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:39.260795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:39.261568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:39.261999 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:39.313557 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:39.321650 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-ba5a5433-7d82-4335-af0d-a37cb51d31cb tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.169322 Jun 15 15:08:39.322221 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 613/1227] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:39 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:39.397855 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:39.406710 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-f85a7647-6a73-4140-9f84-56d0dc52e788 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.159759 Jun 15 15:08:39.407347 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 615/1228] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:39 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:40.338144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:40.338753 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:40.346300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:40.346751 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:40.347526 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:40.347964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:40.425870 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:40.426492 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:40.432939 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:40.434830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:40.434830 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:40.435376 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:40.496358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:40.505073 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6ea70c9b-d40b-46f2-9fd9-5d2bc228bb63 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.170731 Jun 15 15:08:40.523890 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 614/1229] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:40 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:40.585169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:40.593835 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d89793e5-2d94-4cf1-b83c-aaed9878f1a0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1367 microversion: 2.1 time: 0.173160 Jun 15 15:08:40.596893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 616/1230] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:40 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:41.522064 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:41.522664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:41.529089 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:41.529565 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:41.530746 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:41.531139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:41.611002 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:41.611620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:41.618342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:41.618818 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:41.619588 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:41.620308 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:41.674581 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:41.682214 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-8bd4ca01-a247-460b-8e29-791b06be6d95 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.163983 Jun 15 15:08:41.682784 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 615/1231] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:41 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:41.760051 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:41.767531 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5cce0848-3805-440a-a1c5-99155d701d70 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1555 microversion: 2.1 time: 0.160710 Jun 15 15:08:41.768109 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 617/1232] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:41 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:08:41.783415 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9ed3bb0b-03f3-4667-9a2f-2cde630c381a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:41.783840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9ed3bb0b-03f3-4667-9a2f-2cde630c381a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:41.790062 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ed3bb0b-03f3-4667-9a2f-2cde630c381a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:41.790508 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ed3bb0b-03f3-4667-9a2f-2cde630c381a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:41.791274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ed3bb0b-03f3-4667-9a2f-2cde630c381a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:41.791708 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9ed3bb0b-03f3-4667-9a2f-2cde630c381a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:41.869514 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9ed3bb0b-03f3-4667-9a2f-2cde630c381a tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089988 Jun 15 15:08:41.870367 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 616/1233] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 15:08:41 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:42.699610 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:42.700296 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:42.706869 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:42.707321 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:42.708179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:42.708883 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:42.853341 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:42.854327 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-84371f18-a771-4b9f-9c21-97400412917d req-30ef4589-052a-4502-9983-99e2cec49aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcef133-6d80-4212-9289-831c557ad573", "tag": "7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:42.861805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-61f8a33a-8b86-4872-81c1-1282ac74bea6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.166002 Jun 15 15:08:42.870272 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 618/1234] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:42 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:42.870467 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-84371f18-a771-4b9f-9c21-97400412917d req-30ef4589-052a-4502-9983-99e2cec49aa6 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:42.870467 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-84371f18-a771-4b9f-9c21-97400412917d req-30ef4589-052a-4502-9983-99e2cec49aa6 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:42.876673 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-84371f18-a771-4b9f-9c21-97400412917d req-30ef4589-052a-4502-9983-99e2cec49aa6 service nova] Creating event network-changed:7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e for instance bfcef133-6d80-4212-9289-831c557ad573 on hv-cinder-78729 Jun 15 15:08:42.881939 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-84371f18-a771-4b9f-9c21-97400412917d req-30ef4589-052a-4502-9983-99e2cec49aa6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031656 Jun 15 15:08:42.882541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 617/1235] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:08:43.879059 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:43.879655 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:43.886245 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:43.886698 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:43.887460 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:43.887896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:44.032533 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:44.040351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1f3ac76a-0893-4633-aac6-e16f54f68887 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.165096 Jun 15 15:08:44.040919 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 619/1236] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:43 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:45.058804 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:45.059502 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:45.066395 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:45.066845 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:45.067608 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:45.068044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:45.199042 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:45.207245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c1bcb308-82e4-4809-9e39-9664452b0f1c tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.153166 Jun 15 15:08:45.207842 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 618/1237] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:45 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:46.223528 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:46.224273 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:46.230729 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:46.231153 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:46.231907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:46.232381 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:46.370623 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:46.378676 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4845ee9e-7df1-4e47-bcd5-b5d98fc6d698 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.159036 Jun 15 15:08:46.379719 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 620/1238] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:46 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:47.395393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:47.396022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:47.402715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:47.403170 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:47.403941 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:47.404537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:47.536677 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:47.544661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-d7d2d9ca-ccb4-44cc-b835-fb48f8c6a7f5 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.153076 Jun 15 15:08:47.545350 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 619/1239] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:47 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:48.289371 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-c65f51b1-e0ee-4992-b814-48b585e396aa req-e7e653c8-79c2-457b-8152-9bbe91fb2e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c621a06-3b52-4c55-b8e8-a2ac174c911d", "name": "network-vif-plugged", "status": "completed", "tag": "2ceb2088-adbb-49d7-86f9-cfc777d30afa"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:48.299179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-c65f51b1-e0ee-4992-b814-48b585e396aa req-e7e653c8-79c2-457b-8152-9bbe91fb2e6b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:48.299628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-c65f51b1-e0ee-4992-b814-48b585e396aa req-e7e653c8-79c2-457b-8152-9bbe91fb2e6b service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:48.310617 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-c65f51b1-e0ee-4992-b814-48b585e396aa req-e7e653c8-79c2-457b-8152-9bbe91fb2e6b service nova] Creating event network-vif-plugged:2ceb2088-adbb-49d7-86f9-cfc777d30afa for instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d on hv-cinder-78729 Jun 15 15:08:48.315695 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-c65f51b1-e0ee-4992-b814-48b585e396aa req-e7e653c8-79c2-457b-8152-9bbe91fb2e6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029847 Jun 15 15:08:48.316252 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 621/1240] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:08:48.563051 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:48.563718 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:48.570239 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:48.570697 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:48.571574 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:48.572016 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:48.735965 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:48.743770 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-db480bc7-e8c3-42b0-b16c-ea13078bafde tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.185946 Jun 15 15:08:48.744389 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 620/1241] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:48 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:49.762179 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:49.762900 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:49.769217 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:49.769836 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:49.770602 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:49.771038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:49.905450 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:49.913095 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-3901c454-25a6-4c5d-a43e-667f315905df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1265 microversion: 2.1 time: 0.155603 Jun 15 15:08:49.913655 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 622/1242] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:49 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:50.930400 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:50.930953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:50.937738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:50.938190 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:50.938951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:50.939383 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:51.078212 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:51.086048 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c6f449de-f0d2-4424-ab04-d57571c3ea98 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1451 microversion: 2.1 time: 0.159569 Jun 15 15:08:51.086612 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 621/1243] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:50 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:51.102279 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:08:51.102923 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:08:51.109495 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:51.109943 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:51.110735 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:51.111170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:51.241141 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:08:51.249107 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a9e2e99-bee0-44b2-8932-5e8375bd15dd tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1451 microversion: 2.1 time: 0.150775 Jun 15 15:08:51.249670 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 623/1244] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:08:51 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:08:53.635461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-258ca9d2-d15a-45da-9bcd-a872422c2a19 req-09adcaad-337c-4021-820d-c4f5f4d10d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c621a06-3b52-4c55-b8e8-a2ac174c911d", "tag": "2ceb2088-adbb-49d7-86f9-cfc777d30afa"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:08:53.647906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-258ca9d2-d15a-45da-9bcd-a872422c2a19 req-09adcaad-337c-4021-820d-c4f5f4d10d89 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:08:53.648380 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-258ca9d2-d15a-45da-9bcd-a872422c2a19 req-09adcaad-337c-4021-820d-c4f5f4d10d89 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:08:53.660268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-258ca9d2-d15a-45da-9bcd-a872422c2a19 req-09adcaad-337c-4021-820d-c4f5f4d10d89 service nova] Creating event network-changed:2ceb2088-adbb-49d7-86f9-cfc777d30afa for instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d on hv-cinder-78729 Jun 15 15:08:53.665326 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-258ca9d2-d15a-45da-9bcd-a872422c2a19 req-09adcaad-337c-4021-820d-c4f5f4d10d89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 Jun 15 15:08:53.666566 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 622/1245] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:10.347191 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=31 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:10.347949 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=92 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:10.351862 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e37e3381-d0ae-4e54-964b-c32f44f7222b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:10.358193 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e37e3381-d0ae-4e54-964b-c32f44f7222b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:10.358703 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e37e3381-d0ae-4e54-964b-c32f44f7222b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:10.359149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e37e3381-d0ae-4e54-964b-c32f44f7222b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:10.359909 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e37e3381-d0ae-4e54-964b-c32f44f7222b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:10.360366 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e37e3381-d0ae-4e54-964b-c32f44f7222b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:10.384481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e37e3381-d0ae-4e54-964b-c32f44f7222b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/ips" status: 200 len: 148 microversion: 2.1 time: 0.039097 Jun 15 15:10:10.386891 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 624/1246] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 15:10:10 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:13.031960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=31 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:13.032724 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=74 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:13.037354 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-21ef9d6d-b232-4124-ad89-b319fb4c9345 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b03ca199-273b-4d89-82ba-a3b9dc538a20"}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:13.039657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-21ef9d6d-b232-4124-ad89-b319fb4c9345 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:13.045259 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21ef9d6d-b232-4124-ad89-b319fb4c9345 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:13.045813 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21ef9d6d-b232-4124-ad89-b319fb4c9345 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:13.046523 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21ef9d6d-b232-4124-ad89-b319fb4c9345 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:13.047021 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-21ef9d6d-b232-4124-ad89-b319fb4c9345 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:13.847516 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-21ef9d6d-b232-4124-ad89-b319fb4c9345 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818138 Jun 15 15:10:13.848416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 623/1247] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:10:13 2022] POST /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:22.386333 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b03ca199-273b-4d89-82ba-a3b9dc538a20"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:22.387406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:22.390985 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:22.396030 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:22.396515 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:22.397319 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:22.397761 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:22.530440 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Invalid volume: volume b03ca199-273b-4d89-82ba-a3b9dc538a20 is already attached to instances: bfcef133-6d80-4212-9289-831c557ad573 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: POST /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments HTTP/1.1 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 74 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:10:22.532167 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {"volumeAttachment": {"volumeId": "b03ca199-273b-4d89-82ba-a3b9dc538a20"}} Jun 15 15:10:22.534085 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Invalid volume: volume b03ca199-273b-4d89-82ba-a3b9dc538a20 is already attached to instances: bfcef133-6d80-4212-9289-831c557ad573 Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'server_id': 'bfcef133-6d80-4212-9289-831c557ad573', 'body': {'volumeAttachment': {'volumeId': 'b03ca199-273b-4d89-82ba-a3b9dc538a20'}}} Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b03ca199-273b-4d89-82ba-a3b9dc538a20 is already attached to instances: bfcef133-6d80-4212-9289-831c557ad573 Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:10:22.535134 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b03ca199-273b-4d89-82ba-a3b9dc538a20 is already attached to instances: bfcef133-6d80-4212-9289-831c557ad573 Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:22.536800 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b03ca199-273b-4d89-82ba-a3b9dc538a20 is already attached to instances: bfcef133-6d80-4212-9289-831c557ad573 Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 400 to user: Invalid volume: volume b03ca199-273b-4d89-82ba-a3b9dc538a20 is already attached to instances: bfcef133-6d80-4212-9289-831c557ad573 {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5a297e28-3a27-484f-a3f6-24a46ac5dadc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151308 Jun 15 15:10:22.538402 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 625/1248] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:10:22 2022] POST /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:10:22.596069 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:22.596683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:22.603442 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:22.603897 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:22.604693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:22.605135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:22.740579 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lazy-loading 'services' on Instance uuid bfcef133-6d80-4212-9289-831c557ad573 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:10:22.991267 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-b0f0668d-31a0-4468-9274-2be3c626d671 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments/b03ca199-273b-4d89-82ba-a3b9dc538a20" status: 202 len: 0 microversion: 2.1 time: 0.399285 Jun 15 15:10:22.991865 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 624/1249] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 15:10:22 2022] DELETE /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments/b03ca199-273b-4d89-82ba-a3b9dc538a20 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:10:23.000947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-37e1ca6f-4bee-4397-b38d-ac3affd155ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:23.001877 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-37e1ca6f-4bee-4397-b38d-ac3affd155ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:23.017951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37e1ca6f-4bee-4397-b38d-ac3affd155ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:23.017951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37e1ca6f-4bee-4397-b38d-ac3affd155ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:23.017951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37e1ca6f-4bee-4397-b38d-ac3affd155ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:23.017951 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-37e1ca6f-4bee-4397-b38d-ac3affd155ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:23.042037 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-37e1ca6f-4bee-4397-b38d-ac3affd155ed tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045328 Jun 15 15:10:23.042915 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 626/1250] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:10:22 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:10:24.055655 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-f3a2f42c-6ece-4c86-bf23-df9ecce94565 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:24.056740 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-f3a2f42c-6ece-4c86-bf23-df9ecce94565 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:24.063931 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f3a2f42c-6ece-4c86-bf23-df9ecce94565 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:24.064654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f3a2f42c-6ece-4c86-bf23-df9ecce94565 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:24.065182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f3a2f42c-6ece-4c86-bf23-df9ecce94565 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:24.065615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-f3a2f42c-6ece-4c86-bf23-df9ecce94565 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:24.095082 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-f3a2f42c-6ece-4c86-bf23-df9ecce94565 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Jun 15 15:10:24.095750 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 625/1251] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:10:24 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:10:25.107190 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-2d89ea74-5f87-462d-8f32-3ea15e1c0add tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:25.108327 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-2d89ea74-5f87-462d-8f32-3ea15e1c0add tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:25.114937 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d89ea74-5f87-462d-8f32-3ea15e1c0add tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:25.115395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d89ea74-5f87-462d-8f32-3ea15e1c0add tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:25.116196 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d89ea74-5f87-462d-8f32-3ea15e1c0add tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:25.116648 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-2d89ea74-5f87-462d-8f32-3ea15e1c0add tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:25.147006 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-2d89ea74-5f87-462d-8f32-3ea15e1c0add tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043913 Jun 15 15:10:25.147568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 627/1252] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:10:25 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:10:25.204713 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:25.205236 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:25.211877 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:25.212372 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:25.213148 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:25.213586 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:25.240672 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:10:25.521005 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3b3fba9e-09a3-4e87-914c-481ae39ff873 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 204 len: 0 microversion: 2.1 time: 0.320580 Jun 15 15:10:25.521911 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 626/1253] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:10:25 2022] DELETE /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:10:25.532213 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:25.532881 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:25.539849 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:25.540351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:25.541142 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:25.541644 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:25.687956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:25.695475 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-b50bf090-1c30-4565-889e-c00a29014ffc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1680 microversion: 2.1 time: 0.168968 Jun 15 15:10:25.696044 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 628/1254] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:25 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:26.713631 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:26.714256 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:26.723687 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:26.724168 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:26.724960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:26.725399 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:26.865167 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:26.873043 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-12037c55-a785-401a-8603-ec5c28729c60 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1680 microversion: 2.1 time: 0.163763 Jun 15 15:10:26.873620 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 627/1255] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:26 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:27.752688 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:10:27.753394 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Wed Jun 15 15:10:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:10:27.891236 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:27.891856 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:27.898023 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:27.898475 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:27.899253 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:27.899692 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:28.110997 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:28.118673 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-29efb56f-1888-4cb9-9704-86e087ee30cc tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1680 microversion: 2.1 time: 0.231989 Jun 15 15:10:28.119568 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 629/1256] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:27 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:28.605600 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-96dfe228-0ae0-4f05-b49e-c6c0e84a5ab7 req-be3d95e7-dcc3-4272-9e06-e1a9df97a7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcef133-6d80-4212-9289-831c557ad573", "name": "network-vif-deleted", "tag": "7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:28.617229 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-96dfe228-0ae0-4f05-b49e-c6c0e84a5ab7 req-be3d95e7-dcc3-4272-9e06-e1a9df97a7d2 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:28.617697 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-96dfe228-0ae0-4f05-b49e-c6c0e84a5ab7 req-be3d95e7-dcc3-4272-9e06-e1a9df97a7d2 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:28.630443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-96dfe228-0ae0-4f05-b49e-c6c0e84a5ab7 req-be3d95e7-dcc3-4272-9e06-e1a9df97a7d2 service nova] Creating event network-vif-deleted:7f37a4f1-2d4d-447c-93a7-63d0bb86ab6e for instance bfcef133-6d80-4212-9289-831c557ad573 on hv-cinder-78729 Jun 15 15:10:28.636820 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-96dfe228-0ae0-4f05-b49e-c6c0e84a5ab7 req-be3d95e7-dcc3-4272-9e06-e1a9df97a7d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 Jun 15 15:10:28.637426 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 628/1257] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:29.137447 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:29.138154 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:29.145653 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:29.146108 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:29.146893 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:29.147332 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:29.181358 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:29.181802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:29.182255 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lazy-loading 'fault' on Instance uuid bfcef133-6d80-4212-9289-831c557ad573 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:10:29.226106 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:29.234440 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-faddc1e1-6da8-4054-9c5f-c0a1b627a070 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 200 len: 1331 microversion: 2.1 time: 0.100845 Jun 15 15:10:29.235028 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 630/1258] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:29 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:30.252765 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:30.253481 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:30.259684 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:30.260159 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:30.260928 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:30.261366 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:30.274473 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 HTTP/1.1 Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:10:30.276116 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:10:30.278036 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'bfcef133-6d80-4212-9289-831c557ad573'} Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:10:30.279189 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:10:30.280951 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:30.282545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:10:30.282545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-868a9f88-f872-4120-8905-5278ab3145c5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 404 len: 111 microversion: 2.1 time: 0.030430 Jun 15 15:10:30.282545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 629/1259] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:30 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:10:30.286553 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1843328a-192c-4e70-a45c-0fb1cbe8be88 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '.version_select at 0x7fb8acc1ca60>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:30.289774 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1843328a-192c-4e70-a45c-0fb1cbe8be88 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [f8f30b42-9a96-4e7d-b9b8-0c0c969c8def] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 15:10:31.297924 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [None req-1843328a-192c-4e70-a45c-0fb1cbe8be88 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [f8f30b42-9a96-4e7d-b9b8-0c0c969c8def] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 46266. Jun 15 15:10:31.379266 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1843328a-192c-4e70-a45c-0fb1cbe8be88 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124253051" status: 202 len: 0 microversion: 2.1 time: 1.096562 Jun 15 15:10:31.379850 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 631/1260] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jun 15 15:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124253051 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:10:32.411680 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-cd91ee36-e83a-402e-92df-4c10d941ddac tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: .version_select at 0x7fb8a8514ee0>, body: {"keypair": {"name": "tempest-keypair-2103153796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn1iGmFnC/d0Z4aek1cv0vVUCPGC+ZOXpVZdyPw/KSQnqQNyl7Sy46bGygyrJ11KOymm7XSkajpA97CviP7ZSxBD84vsvPMHdg7j2vvdhCjI6nYwX1kABrLv/xpJImQ8g=="}} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:32.426956 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-cd91ee36-e83a-402e-92df-4c10d941ddac tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:10:32.430776 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.quota [None req-cd91ee36-e83a-402e-92df-4c10d941ddac tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'key_pairs'} {{(pid=124659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:10:32.505995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-cd91ee36-e83a-402e-92df-4c10d941ddac tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098125 Jun 15 15:10:32.506597 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 630/1261] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Jun 15 15:10:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:10:34.767812 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-425431677", "imageRef": "985de9c1-074a-4dbe-96ed-2e68f3628361", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "115a225d-97b8-4fa4-b2b8-ad448d4e5db3"}], "security_groups": [{"name": "tempest-securitygroup--390243974"}], "key_name": "tempest-keypair-2103153796", "user_data": "}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:34.868581 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.network.neutron [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] validate_networks() for [('115a225d-97b8-4fa4-b2b8-ad448d4e5db3', None, None, None, None, None)] {{(pid=124660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:10:35.279370 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:10:35.279805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image limits 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:10:35.280351 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Flavor pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:10:35.280771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Image pref 0:0:0 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:10:35.281190 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.virt.hardware [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:10:35.289925 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:35.290377 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:35.291298 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:35.291692 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:35.309469 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:10:35.314216 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.quota [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Getting quotas for user 17f8c496bb0049719cd67c457ba40f35 and project e6829672292b4494931500de38f4d924. Resources: {'instances', 'ram', 'cores'} {{(pid=124660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:10:35.325118 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Going to run 1 instances... {{(pid=124660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:10:35.327518 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='985de9c1-074a-4dbe-96ed-2e68f3628361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:10:35.465288 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-7bfa1827-6c6e-487b-8321-c0985894571c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.703002 Jun 15 15:10:35.465955 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 632/1262] 10.222.0.42 () {60 vars in 1146 bytes} [Wed Jun 15 15:10:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:10:35.476066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4065183e-796a-40d7-9184-c4e16e7ed456 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:35.476701 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4065183e-796a-40d7-9184-c4e16e7ed456 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:35.533393 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-4065183e-796a-40d7-9184-c4e16e7ed456 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:35.540287 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4065183e-796a-40d7-9184-c4e16e7ed456 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1241 microversion: 2.1 time: 0.067967 Jun 15 15:10:35.540866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 631/1263] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:35 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:36.558263 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:36.558924 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:36.565662 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:36.566151 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:36.566929 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:36.567370 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:36.631116 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:36.638914 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4dc1f45f-69ae-4258-8133-94fa3013340d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1237 microversion: 2.1 time: 0.084896 Jun 15 15:10:36.639548 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 633/1264] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:36 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:37.659419 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:37.660011 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:37.666664 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:37.667111 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:37.667926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:37.668503 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:37.941139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:37.941139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-dcc04d5f-77bf-486a-8182-e80520e350ef tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1299 microversion: 2.1 time: 0.117604 Jun 15 15:10:37.941139 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 632/1265] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:37 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:38.796428 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:38.797065 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:38.804759 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:38.805479 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:38.806465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:38.807031 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:38.996845 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:39.004636 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-4bedcff6-a976-4e39-8560-a216ec0255e5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1366 microversion: 2.1 time: 0.212850 Jun 15 15:10:39.006500 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 634/1266] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:38 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:39.125403 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-09832354-27a1-430c-a2e4-6defdb72e6f9 req-9c1e0352-b574-4e6b-a7af-4d35288db735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "765480bf-cff3-4c8f-aa6a-dd17ae0fb757", "tag": "a89d2584-3e92-475d-8e2d-108940f1651e"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:39.135123 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-09832354-27a1-430c-a2e4-6defdb72e6f9 req-9c1e0352-b574-4e6b-a7af-4d35288db735 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:39.135761 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-09832354-27a1-430c-a2e4-6defdb72e6f9 req-9c1e0352-b574-4e6b-a7af-4d35288db735 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:39.150228 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-09832354-27a1-430c-a2e4-6defdb72e6f9 req-9c1e0352-b574-4e6b-a7af-4d35288db735 service nova] Creating event network-changed:a89d2584-3e92-475d-8e2d-108940f1651e for instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 on hv-cinder-78729 Jun 15 15:10:39.155318 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-09832354-27a1-430c-a2e4-6defdb72e6f9 req-9c1e0352-b574-4e6b-a7af-4d35288db735 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034786 Jun 15 15:10:39.155929 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 633/1267] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:40.021840 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:40.022491 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:40.029311 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:40.029754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:40.030515 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:40.030944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:40.164826 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:40.173451 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-cf3a042d-ef04-45c1-8e4c-2094ff814408 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1366 microversion: 2.1 time: 0.155737 Jun 15 15:10:40.174021 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 635/1268] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:40 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:41.191513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:41.192251 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:41.198468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:41.198932 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:41.199716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:41.200227 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:41.330436 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:41.337930 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c9c8e592-6a09-47e5-b4ef-bfdf363270eb tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1366 microversion: 2.1 time: 0.151169 Jun 15 15:10:41.338495 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 634/1269] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:41 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:42.355170 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:42.355757 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:42.362819 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:42.363266 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:42.364046 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:42.364519 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:42.497122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:42.504975 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bd81b9cf-98d3-4212-968e-90e8238850a2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1366 microversion: 2.1 time: 0.153568 Jun 15 15:10:42.505757 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 636/1270] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:42 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:43.522078 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:43.522683 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:43.525112 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:43.530209 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:43.530659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:43.531430 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:43.531871 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:43.536716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:43.669537 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:43.678548 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a83ef8ec-164b-4def-a7d9-930465ee5249 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1366 microversion: 2.1 time: 0.160302 Jun 15 15:10:43.681721 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 635/1271] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:43 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:44.696339 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:44.696957 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:44.703896 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:44.704373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:44.705148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:44.705580 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:44.795478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-f743121a-f308-4e3b-87ca-01930813b97e req-c20a02da-5703-4dbd-b71a-ccecc93f6b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765480bf-cff3-4c8f-aa6a-dd17ae0fb757", "name": "network-vif-plugged", "status": "completed", "tag": "a89d2584-3e92-475d-8e2d-108940f1651e"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:44.805568 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f743121a-f308-4e3b-87ca-01930813b97e req-c20a02da-5703-4dbd-b71a-ccecc93f6b8d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:44.806010 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-f743121a-f308-4e3b-87ca-01930813b97e req-c20a02da-5703-4dbd-b71a-ccecc93f6b8d service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:44.818039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-f743121a-f308-4e3b-87ca-01930813b97e req-c20a02da-5703-4dbd-b71a-ccecc93f6b8d service nova] Creating event network-vif-plugged:a89d2584-3e92-475d-8e2d-108940f1651e for instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 on hv-cinder-78729 Jun 15 15:10:44.823194 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-f743121a-f308-4e3b-87ca-01930813b97e req-c20a02da-5703-4dbd-b71a-ccecc93f6b8d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032562 Jun 15 15:10:44.824543 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 636/1272] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:10:44.846544 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:44.853998 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-9e4b974c-9148-4516-802b-c7221fe20a61 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1366 microversion: 2.1 time: 0.161628 Jun 15 15:10:44.854564 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 637/1273] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:44 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:45.873856 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:45.874468 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:45.876501 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell0:SELECT=6 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:45.882657 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:45.885162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:45.885162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:45.885162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:46.019217 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:46.026842 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-6216b7d7-61ef-446e-950a-e69a63a8758b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1366 microversion: 2.1 time: 0.158861 Jun 15 15:10:46.027408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 637/1274] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:45 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:47.043771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:47.044417 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:47.046280 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=2 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:47.046969 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell0:SELECT=6 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:47.052947 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:47.053399 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:47.054169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:47.054600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:47.190627 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:47.198244 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d9b883f6-8ace-4af7-9967-3079913b889c tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1555 microversion: 2.1 time: 0.158378 Jun 15 15:10:47.198804 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 638/1275] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:47 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:47.215499 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-63dd83bf-147e-4db4-bd90-60f8c5007e9e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:47.216144 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-63dd83bf-147e-4db4-bd90-60f8c5007e9e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:47.222794 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63dd83bf-147e-4db4-bd90-60f8c5007e9e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:47.223233 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63dd83bf-147e-4db4-bd90-60f8c5007e9e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:47.224026 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63dd83bf-147e-4db4-bd90-60f8c5007e9e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:47.224478 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-63dd83bf-147e-4db4-bd90-60f8c5007e9e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:47.302625 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-63dd83bf-147e-4db4-bd90-60f8c5007e9e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091090 Jun 15 15:10:47.303219 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 638/1276] 10.222.0.42 () {58 vars in 1274 bytes} [Wed Jun 15 15:10:47 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:48.265063 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-e68d63d1-ec6b-4236-a155-6aaa59651981 req-ca570ab3-e414-4145-ad40-b52986246c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "765480bf-cff3-4c8f-aa6a-dd17ae0fb757", "tag": "a89d2584-3e92-475d-8e2d-108940f1651e"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:48.273612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e68d63d1-ec6b-4236-a155-6aaa59651981 req-ca570ab3-e414-4145-ad40-b52986246c19 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:48.274139 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-e68d63d1-ec6b-4236-a155-6aaa59651981 req-ca570ab3-e414-4145-ad40-b52986246c19 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:48.285996 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-e68d63d1-ec6b-4236-a155-6aaa59651981 req-ca570ab3-e414-4145-ad40-b52986246c19 service nova] Creating event network-changed:a89d2584-3e92-475d-8e2d-108940f1651e for instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 on hv-cinder-78729 Jun 15 15:10:48.291156 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-e68d63d1-ec6b-4236-a155-6aaa59651981 req-ca570ab3-e414-4145-ad40-b52986246c19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030571 Jun 15 15:10:48.291720 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 639/1277] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:54.427014 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [req-982f0e99-ce6d-44dc-b2c2-52ce1b5f31e9 req-a5a3a5c7-3802-41aa-832e-21c98019107e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c621a06-3b52-4c55-b8e8-a2ac174c911d", "tag": "2ceb2088-adbb-49d7-86f9-cfc777d30afa"}]} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:54.430268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:54.434325 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:54.438171 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:54.443255 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:54.443711 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:54.444042 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-982f0e99-ce6d-44dc-b2c2-52ce1b5f31e9 req-a5a3a5c7-3802-41aa-832e-21c98019107e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:54.444513 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:54.444628 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [req-982f0e99-ce6d-44dc-b2c2-52ce1b5f31e9 req-a5a3a5c7-3802-41aa-832e-21c98019107e service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:54.444953 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:54.448822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=83 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:10:54.457643 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.compute.server_external_events [req-982f0e99-ce6d-44dc-b2c2-52ce1b5f31e9 req-a5a3a5c7-3802-41aa-832e-21c98019107e service nova] Creating event network-changed:2ceb2088-adbb-49d7-86f9-cfc777d30afa for instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d on hv-cinder-78729 Jun 15 15:10:54.463294 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [req-982f0e99-ce6d-44dc-b2c2-52ce1b5f31e9 req-a5a3a5c7-3802-41aa-832e-21c98019107e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040717 Jun 15 15:10:54.464859 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 640/1278] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:10:54.475417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:10:54.809314 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-03f51988-0436-4662-bd34-35c7bc33dd10 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 204 len: 0 microversion: 2.1 time: 0.390064 Jun 15 15:10:54.809896 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 639/1279] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:10:54 2022] DELETE /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:10:54.819100 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:54.820918 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:54.828809 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:54.829269 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:54.830050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:54.830494 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:55.015538 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:55.023754 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-60150741-5321-49f5-b9ac-7f6cf9ea5440 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1575 microversion: 2.1 time: 0.208889 Jun 15 15:10:55.024365 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 641/1280] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:54 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:56.042067 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:56.042769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:56.050615 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:56.051067 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:56.051848 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:56.052358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:56.193828 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:56.201614 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-895619f9-680b-4c5b-b1ba-8adf49f3a62d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1575 microversion: 2.1 time: 0.163893 Jun 15 15:10:56.202187 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 640/1281] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:56 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:57.219762 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:57.220432 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:57.227251 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:57.227707 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:57.228517 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:57.228970 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:57.385373 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:57.393578 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-32562bcf-e604-45e3-a606-32757902417d tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1457 microversion: 2.1 time: 0.178543 Jun 15 15:10:57.394244 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 642/1282] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:57 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1457 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:57.528605 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-1e4d9355-bc22-41b0-8ed6-7d79170a9b9d req-68413cc7-1c91-4775-9bdb-595c84c34407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c621a06-3b52-4c55-b8e8-a2ac174c911d", "name": "network-vif-deleted", "tag": "2ceb2088-adbb-49d7-86f9-cfc777d30afa"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:10:57.537870 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-1e4d9355-bc22-41b0-8ed6-7d79170a9b9d req-68413cc7-1c91-4775-9bdb-595c84c34407 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:57.545206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-1e4d9355-bc22-41b0-8ed6-7d79170a9b9d req-68413cc7-1c91-4775-9bdb-595c84c34407 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:57.552884 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-1e4d9355-bc22-41b0-8ed6-7d79170a9b9d req-68413cc7-1c91-4775-9bdb-595c84c34407 service nova] Creating event network-vif-deleted:2ceb2088-adbb-49d7-86f9-cfc777d30afa for instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d on hv-cinder-78729 Jun 15 15:10:57.558171 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-1e4d9355-bc22-41b0-8ed6-7d79170a9b9d req-68413cc7-1c91-4775-9bdb-595c84c34407 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091354 Jun 15 15:10:57.558800 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 641/1283] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:10:58.410907 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:58.411523 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:58.418393 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:58.419165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:58.419936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:58.420395 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:58.452312 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:58.452765 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:58.453209 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lazy-loading 'fault' on Instance uuid 6c621a06-3b52-4c55-b8e8-a2ac174c911d {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:10:58.495980 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:10:58.505297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-93f86c34-da17-4f47-a2c0-8a5a8530c573 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 200 len: 1230 microversion: 2.1 time: 0.097498 Jun 15 15:10:58.505297 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 643/1284] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:58 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:10:59.525095 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:10:59.525792 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 6c621a06-3b52-4c55-b8e8-a2ac174c911d] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:10:59.532848 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:59.533295 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:59.534070 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:10:59.534507 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:10:59.549278 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] HTTP exception thrown: Instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d could not be found. Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Request method failure captured: Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d HTTP/1.1 Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfRC5cW0pZVip5HQhOYojseVu49hHlWKcXXx0ZjEEb0cQlsNP0QI8UAtkMbIN2nDTOrE8dmfEfWW-u4LSyzdvYBonYjtEaI5O0fRyUXnWCUbMlER842SotanYKJzHMzomrpdPlDO7muWX2EeBGPCx8glfgbRqwJO043F2tPxsODFr0Y Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:10:59.551072 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-TestVolumeBootPattern-362759903 Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: e209ae2f7fa7412b95c7c43c74c14426 Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d could not be found. Jun 15 15:10:59.552906 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '6c621a06-3b52-4c55-b8e8-a2ac174c911d'} Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d could not be found. Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:10:59.554417 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d could not be found. Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d could not be found. Jun 15 15:10:59.556693 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:10:59.558408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Returning 404 to user: Instance 6c621a06-3b52-4c55-b8e8-a2ac174c911d could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:10:59.558408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-006bfe5b-1d58-453d-b1f1-18cedf9ea9ca tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d" status: 404 len: 111 microversion: 2.1 time: 0.032285 Jun 15 15:10:59.558408 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 642/1285] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:10:59 2022] GET /compute/v2.1/servers/6c621a06-3b52-4c55-b8e8-a2ac174c911d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:11:03.158952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-22980d49-e26e-4496-81df-2655ed1dd45b req-240f98d8-5ec8-44e0-a562-981cce76d15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f19b50f-eeeb-469a-8308-6e04555a0f56", "tag": "5ee28d82-6aee-4db2-889f-d8743703bdb7"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:11:03.161232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:03.161232 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:11:03.166690 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:03.167150 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:03.167922 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:03.168912 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:03.170321 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-22980d49-e26e-4496-81df-2655ed1dd45b req-240f98d8-5ec8-44e0-a562-981cce76d15a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:03.170777 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-22980d49-e26e-4496-81df-2655ed1dd45b req-240f98d8-5ec8-44e0-a562-981cce76d15a service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:03.182886 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-22980d49-e26e-4496-81df-2655ed1dd45b req-240f98d8-5ec8-44e0-a562-981cce76d15a service nova] Creating event network-changed:5ee28d82-6aee-4db2-889f-d8743703bdb7 for instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 on hv-cinder-78729 Jun 15 15:11:03.189434 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-22980d49-e26e-4496-81df-2655ed1dd45b req-240f98d8-5ec8-44e0-a562-981cce76d15a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034115 Jun 15 15:11:03.190738 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 643/1286] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:11:03.199771 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Going to try to terminate instance {{(pid=124660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:11:03.475489 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-e60e50ef-a89c-4804-ad19-2e2c6c2127df tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 204 len: 0 microversion: 2.1 time: 0.322721 Jun 15 15:11:03.476168 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 644/1287] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:11:03 2022] DELETE /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:11:03.484921 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:03.485626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:11:03.492300 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:03.492780 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:03.493549 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:03.494243 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:03.654979 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:11:03.663039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-37b2fd52-5b97-4803-8709-0477757e6ca6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1577 microversion: 2.1 time: 0.182435 Jun 15 15:11:03.663730 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 644/1288] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:11:03 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:11:04.681326 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:04.682052 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:11:04.689862 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:04.690318 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:04.691103 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:04.691551 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:04.909819 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:11:04.917250 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-00d16221-ac9b-4ea4-b639-2b80a8bc72ea tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1458 microversion: 2.1 time: 0.240221 Jun 15 15:11:04.917824 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 645/1289] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:11:04 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1458 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:11:05.455294 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-74da3b01-e4cc-41e1-9740-f4a2fae88eb2 req-9dd3819a-50fe-46fd-8d0b-45a9e627ba87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f19b50f-eeeb-469a-8308-6e04555a0f56", "name": "network-vif-deleted", "tag": "5ee28d82-6aee-4db2-889f-d8743703bdb7"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:11:05.465135 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-74da3b01-e4cc-41e1-9740-f4a2fae88eb2 req-9dd3819a-50fe-46fd-8d0b-45a9e627ba87 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:05.470039 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-74da3b01-e4cc-41e1-9740-f4a2fae88eb2 req-9dd3819a-50fe-46fd-8d0b-45a9e627ba87 service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:05.479161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-74da3b01-e4cc-41e1-9740-f4a2fae88eb2 req-9dd3819a-50fe-46fd-8d0b-45a9e627ba87 service nova] Creating event network-vif-deleted:5ee28d82-6aee-4db2-889f-d8743703bdb7 for instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 on hv-cinder-78729 Jun 15 15:11:05.484676 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-74da3b01-e4cc-41e1-9740-f4a2fae88eb2 req-9dd3819a-50fe-46fd-8d0b-45a9e627ba87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032915 Jun 15 15:11:05.488210 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 645/1290] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:11:05.935148 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:05.935818 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:11:05.944233 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:05.944689 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:05.945461 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:05.945899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:06.010936 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209ae2f7fa7412b95c7c43c74c14426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f361ea99aa45c185d50d83c84e5dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:11:06.019291 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-850a23dd-a417-4067-abe4-2f6b632fec7b tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 200 len: 1225 microversion: 2.1 time: 0.088179 Jun 15 15:11:06.019872 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 646/1291] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:11:05 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:11:07.038097 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:07.038805 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: 2f19b50f-eeeb-469a-8308-6e04555a0f56] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:11:07.045715 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:07.046167 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:07.047003 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:07.047443 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:07.061146 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] HTTP exception thrown: Instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 could not be found. Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Request method failure captured: Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 HTTP/1.1 Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfRC5cW0pZVip5HQhOYojseVu49hHlWKcXXx0ZjEEb0cQlsNP0QI8UAtkMbIN2nDTOrE8dmfEfWW-u4LSyzdvYBonYjtEaI5O0fRyUXnWCUbMlER842SotanYKJzHMzomrpdPlDO7muWX2EeBGPCx8glfgbRqwJO043F2tPxsODFr0Y Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:11:07.062815 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: e209ae2f7fa7412b95c7c43c74c14426 Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 could not be found. Jun 15 15:11:07.064743 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '2f19b50f-eeeb-469a-8308-6e04555a0f56'} Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 could not be found. Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:11:07.065647 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 could not be found. Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 could not be found. Jun 15 15:11:07.067363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.068956 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Returning 404 to user: Instance 2f19b50f-eeeb-469a-8308-6e04555a0f56 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:11:07.068956 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-827fe443-7b77-41dd-82d9-bf000223023a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56" status: 404 len: 111 microversion: 2.1 time: 0.031084 Jun 15 15:11:07.068956 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 646/1292] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:11:07 2022] GET /compute/v2.1/servers/2f19b50f-eeeb-469a-8308-6e04555a0f56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:11:07.579767 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:07.581316 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:11:07.586984 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:07.587429 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:07.588228 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:07.588665 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:07.602795 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] HTTP exception thrown: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Request method failure captured: Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: DELETE /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e HTTP/1.1 Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfRC5cW0pZVip5HQhOYojseVu49hHlWKcXXx0ZjEEb0cQlsNP0QI8UAtkMbIN2nDTOrE8dmfEfWW-u4LSyzdvYBonYjtEaI5O0fRyUXnWCUbMlER842SotanYKJzHMzomrpdPlDO7muWX2EeBGPCx8glfgbRqwJO043F2tPxsODFr0Y Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:11:07.604481 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: e209ae2f7fa7412b95c7c43c74c14426 Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.606589 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'ed4fc143-9763-4dfc-94c5-2cddc7e27c0e'} Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:11:07.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.609303 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.611169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Returning 404 to user: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:11:07.611169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-d6c178c4-1f64-4aa0-9136-f8bb3ef2656a tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 404 len: 111 microversion: 2.1 time: 0.029988 Jun 15 15:11:07.611169 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 647/1293] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:11:07 2022] DELETE /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:11:07.614744 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:07.615364 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] [instance: ed4fc143-9763-4dfc-94c5-2cddc7e27c0e] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:11:07.621685 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:07.622175 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:07.622943 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:11:07.623382 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:11:07.636654 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] HTTP exception thrown: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Request method failure captured: Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e HTTP/1.1 Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfRC5cW0pZVip5HQhOYojseVu49hHlWKcXXx0ZjEEb0cQlsNP0QI8UAtkMbIN2nDTOrE8dmfEfWW-u4LSyzdvYBonYjtEaI5O0fRyUXnWCUbMlER842SotanYKJzHMzomrpdPlDO7muWX2EeBGPCx8glfgbRqwJO043F2tPxsODFr0Y Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:11:07.639232 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_79f361ea99aa45c185d50d83c84e5dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: 79f361ea99aa45c185d50d83c84e5dc1 Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-TestVolumeBootPattern-362759903 Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: e209ae2f7fa7412b95c7c43c74c14426 Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-TestVolumeBootPattern-362759903-project Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.641598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'ed4fc143-9763-4dfc-94c5-2cddc7e27c0e'} Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:11:07.642703 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. Jun 15 15:11:07.644580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:11:07.646169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Returning 404 to user: Instance ed4fc143-9763-4dfc-94c5-2cddc7e27c0e could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:11:07.646169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-41237c7f-5ec8-4a0f-aee5-55142cd3f6a6 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e" status: 404 len: 111 microversion: 2.1 time: 0.029253 Jun 15 15:11:07.646169 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 647/1294] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:11:07 2022] GET /compute/v2.1/servers/ed4fc143-9763-4dfc-94c5-2cddc7e27c0e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:11:09.145802 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ad61b4bb-96ac-4d58-8ab9-ec309eabd843 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] Calling method '.version_select at 0x7fb8acc98f70>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:11:09.216377 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ad61b4bb-96ac-4d58-8ab9-ec309eabd843 tempest-TestVolumeBootPattern-362759903 tempest-TestVolumeBootPattern-362759903-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-993253485" status: 202 len: 0 microversion: 2.1 time: 0.074133 Jun 15 15:11:09.216884 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 648/1295] 10.222.0.42 () {58 vars in 1259 bytes} [Wed Jun 15 15:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-993253485 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:12:03.495545 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-4c2449cb-532d-4a89-a57f-d05548974f37 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:03.496195 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-4c2449cb-532d-4a89-a57f-d05548974f37 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:03.498358 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:12:03.499621 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG dbcounter [-] [124659] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:12:03.506328 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c2449cb-532d-4a89-a57f-d05548974f37 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:03.510053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c2449cb-532d-4a89-a57f-d05548974f37 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:03.510053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c2449cb-532d-4a89-a57f-d05548974f37 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:03.510053 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-4c2449cb-532d-4a89-a57f-d05548974f37 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:03.533182 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-4c2449cb-532d-4a89-a57f-d05548974f37 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/ips" status: 200 len: 149 microversion: 2.1 time: 0.041709 Jun 15 15:12:03.533757 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 648/1296] 10.222.0.42 () {58 vars in 1247 bytes} [Wed Jun 15 15:12:03 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:12:06.156533 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:12:06.157374 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG dbcounter [-] [124660] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:12:06.161600 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-936e8773-42d6-42ca-a16d-eef3d600d633 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81f3bd24-ef11-4c9f-95d8-962e1336cfa3"}} {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:12:06.162715 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-936e8773-42d6-42ca-a16d-eef3d600d633 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:06.169559 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-936e8773-42d6-42ca-a16d-eef3d600d633 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:06.170016 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-936e8773-42d6-42ca-a16d-eef3d600d633 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:06.170782 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-936e8773-42d6-42ca-a16d-eef3d600d633 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:06.171223 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-936e8773-42d6-42ca-a16d-eef3d600d633 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:06.963398 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-936e8773-42d6-42ca-a16d-eef3d600d633 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "POST /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.808250 Jun 15 15:12:06.964124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 649/1297] 10.222.0.42 () {60 vars in 1322 bytes} [Wed Jun 15 15:12:06 2022] POST /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments => generated 194 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:12:14.546166 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:14.546797 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:14.555177 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:14.555630 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:14.556452 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:14.556891 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:14.637837 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.objects.instance [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lazy-loading 'services' on Instance uuid 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 {{(pid=124659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:12:14.853357 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-c113b900-16a4-4083-beb0-019c6328f491 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments/81f3bd24-ef11-4c9f-95d8-962e1336cfa3" status: 202 len: 0 microversion: 2.1 time: 0.311103 Jun 15 15:12:14.853964 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 649/1298] 10.222.0.42 () {58 vars in 1415 bytes} [Wed Jun 15 15:12:14 2022] DELETE /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments/81f3bd24-ef11-4c9f-95d8-962e1336cfa3 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:12:14.864702 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-bfea6276-f170-460c-88c0-4ba6509b4129 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:14.865776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-bfea6276-f170-460c-88c0-4ba6509b4129 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:14.872550 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfea6276-f170-460c-88c0-4ba6509b4129 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:14.873007 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfea6276-f170-460c-88c0-4ba6509b4129 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:14.873813 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfea6276-f170-460c-88c0-4ba6509b4129 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:14.874295 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-bfea6276-f170-460c-88c0-4ba6509b4129 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:14.905230 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-bfea6276-f170-460c-88c0-4ba6509b4129 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046536 Jun 15 15:12:14.905716 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 650/1299] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:12:14 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:12:15.919197 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-0a36e2e7-3607-47c7-a471-4ec1d6efd328 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:15.920226 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-0a36e2e7-3607-47c7-a471-4ec1d6efd328 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:15.926866 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a36e2e7-3607-47c7-a471-4ec1d6efd328 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:15.927316 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a36e2e7-3607-47c7-a471-4ec1d6efd328 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:15.928118 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a36e2e7-3607-47c7-a471-4ec1d6efd328 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:15.928571 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-0a36e2e7-3607-47c7-a471-4ec1d6efd328 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:15.961961 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-0a36e2e7-3607-47c7-a471-4ec1d6efd328 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Jun 15 15:12:15.962541 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 650/1300] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:12:15 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:12:16.973606 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-5e40723d-9cd1-4141-916b-c88e0cbf12a4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:16.974522 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-5e40723d-9cd1-4141-916b-c88e0cbf12a4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:16.981019 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e40723d-9cd1-4141-916b-c88e0cbf12a4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:16.981470 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e40723d-9cd1-4141-916b-c88e0cbf12a4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:16.982224 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e40723d-9cd1-4141-916b-c88e0cbf12a4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:16.982664 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-5e40723d-9cd1-4141-916b-c88e0cbf12a4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:17.012270 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-5e40723d-9cd1-4141-916b-c88e0cbf12a4 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042710 Jun 15 15:12:17.012820 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 651/1301] 10.222.0.42 () {58 vars in 1301 bytes} [Wed Jun 15 15:12:16 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:12:17.069440 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:17.069960 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:17.076532 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:17.076983 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:17.077747 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:17.078185 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:17.103728 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Going to try to terminate instance {{(pid=124659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:12:17.379994 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-3c45f973-a27e-410d-a6a2-000550c3c7aa tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 204 len: 0 microversion: 2.1 time: 0.314077 Jun 15 15:12:17.380626 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 651/1302] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:12:17 2022] DELETE /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:12:17.388727 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:17.389424 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:17.395504 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:17.401176 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:17.401176 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:17.401176 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:17.531465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:12:17.539926 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-71e73f93-f25b-4059-be2d-03044a1fe0e2 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1680 microversion: 2.1 time: 0.154968 Jun 15 15:12:17.540532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 652/1303] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:17 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:12:18.557143 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:18.557854 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:18.564429 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:18.564881 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:18.565645 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:18.566081 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:18.701439 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.policy [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:12:18.709716 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-1de21872-1af8-4bb8-8cd8-9cc4d52d5c6d tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1680 microversion: 2.1 time: 0.156808 Jun 15 15:12:18.710276 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 652/1304] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:18 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:12:19.727412 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:19.727954 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:19.734406 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:19.734857 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:19.742484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:19.742484 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:19.960899 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:12:19.968445 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-868ef3e5-33ab-4ed0-a5c1-e6b986166131 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1680 microversion: 2.1 time: 0.244924 Jun 15 15:12:19.969015 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 653/1305] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:19 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:12:20.415952 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [req-82729949-f8ad-4134-9bbc-f08f080d57da req-7366da1c-7431-4c8f-a4f7-938d7faffedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765480bf-cff3-4c8f-aa6a-dd17ae0fb757", "name": "network-vif-deleted", "tag": "a89d2584-3e92-475d-8e2d-108940f1651e"}]} {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:12:20.425129 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-82729949-f8ad-4134-9bbc-f08f080d57da req-7366da1c-7431-4c8f-a4f7-938d7faffedf service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:20.425580 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [req-82729949-f8ad-4134-9bbc-f08f080d57da req-7366da1c-7431-4c8f-a4f7-938d7faffedf service nova] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:20.436751 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.compute.server_external_events [req-82729949-f8ad-4134-9bbc-f08f080d57da req-7366da1c-7431-4c8f-a4f7-938d7faffedf service nova] Creating event network-vif-deleted:a89d2584-3e92-475d-8e2d-108940f1651e for instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 on hv-cinder-78729 Jun 15 15:12:20.442293 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [req-82729949-f8ad-4134-9bbc-f08f080d57da req-7366da1c-7431-4c8f-a4f7-938d7faffedf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030011 Jun 15 15:12:20.443066 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 653/1306] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Jun 15 15:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:12:20.986315 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:20.986889 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:20.993594 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:20.994048 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:20.994808 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:20.995237 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:21.027240 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:21.027686 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:21.028165 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.objects.instance [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lazy-loading 'fault' on Instance uuid 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 {{(pid=124660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:12:21.077149 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.policy [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8c496bb0049719cd67c457ba40f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6829672292b4494931500de38f4d924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:12:21.087322 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-1e8fd6b9-4935-4f72-a599-1d924b1d6697 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 200 len: 1331 microversion: 2.1 time: 0.104886 Jun 15 15:12:21.087904 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 654/1307] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:20 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:12:22.105695 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:22.106389 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:22.113119 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:22.113560 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:22.114348 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:22.114781 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:22.129162 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 HTTP/1.1 Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:12:22.130771 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:22.132659 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '765480bf-cff3-4c8f-aa6a-dd17ae0fb757'} Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:22.133846 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:22.135692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:22.137301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:22.137301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-9f44523a-e2b1-4724-8e77-dfc735842484 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 404 len: 111 microversion: 2.1 time: 0.031240 Jun 15 15:12:22.137301 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 654/1308] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:22 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:12:22.140852 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-79b3e588-89cc-4a91-84cd-5a66d6e2f286 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '.version_select at 0x7fb8acc83940>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:22.200723 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-79b3e588-89cc-4a91-84cd-5a66d6e2f286 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103153796" status: 202 len: 0 microversion: 2.1 time: 0.063437 Jun 15 15:12:22.201354 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 655/1309] 10.222.0.42 () {58 vars in 1220 bytes} [Wed Jun 15 15:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103153796 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:12:24.204840 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:24.205363 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:24.211779 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:24.212268 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:24.213025 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:24.213454 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:24.226855 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 HTTP/1.1 Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:12:24.228416 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.230022 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '765480bf-cff3-4c8f-aa6a-dd17ae0fb757'} Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:24.230926 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.232635 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.234441 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:24.234441 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-00e6dd44-f077-4d65-b7ad-91e56c61b303 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 404 len: 111 microversion: 2.1 time: 0.028862 Jun 15 15:12:24.234441 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 655/1310] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:12:24 2022] DELETE /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:12:24.239343 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:24.239956 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 765480bf-cff3-4c8f-aa6a-dd17ae0fb757] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:24.246805 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:24.247249 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:24.248005 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:24.248467 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:24.262246 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 HTTP/1.1 Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:12:24.263944 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.265749 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '765480bf-cff3-4c8f-aa6a-dd17ae0fb757'} Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:24.266658 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. Jun 15 15:12:24.268342 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:24.269948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 765480bf-cff3-4c8f-aa6a-dd17ae0fb757 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:24.269948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-fdfc9d21-6bbe-45da-ac84-598f46c70654 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757" status: 404 len: 111 microversion: 2.1 time: 0.031194 Jun 15 15:12:24.269948 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 656/1311] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:24 2022] GET /compute/v2.1/servers/765480bf-cff3-4c8f-aa6a-dd17ae0fb757 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:12:25.529077 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:25.529600 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:25.537661 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.538131 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.538910 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.539349 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.553930 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 HTTP/1.1 Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:12:25.555524 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.557302 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': 'bfcef133-6d80-4212-9289-831c557ad573'} Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:25.558461 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.560161 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.561807 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:25.561807 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-a1c3f9e1-4e4e-47ec-b40d-d9cd5d399df0 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 404 len: 111 microversion: 2.1 time: 0.031811 Jun 15 15:12:25.561807 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 656/1312] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:12:25 2022] DELETE /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:12:25.565292 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:25.566122 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: bfcef133-6d80-4212-9289-831c557ad573] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:25.572880 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.573334 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.574099 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.574599 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.587986 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 HTTP/1.1 Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:12:25.589612 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.591362 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': 'bfcef133-6d80-4212-9289-831c557ad573'} Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:25.592532 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. Jun 15 15:12:25.594265 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.595713 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance bfcef133-6d80-4212-9289-831c557ad573 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:25.595713 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-0b57b73d-d2e0-44e9-86e4-28572bfde0d5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573" status: 404 len: 111 microversion: 2.1 time: 0.029503 Jun 15 15:12:25.595713 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 657/1313] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:25 2022] GET /compute/v2.1/servers/bfcef133-6d80-4212-9289-831c557ad573 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:12:25.599811 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:25.600340 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:25.606484 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.606949 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.607706 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.608172 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.621968 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 HTTP/1.1 Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:12:25.623488 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.625274 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '11c0ee09-8208-4109-a310-0de171036e81'} Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:25.626245 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.627955 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.630208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:25.630208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-e6f57f70-8eec-439c-8257-17470919350b tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 404 len: 111 microversion: 2.1 time: 0.029413 Jun 15 15:12:25.630208 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 657/1314] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:12:25 2022] DELETE /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:12:25.634087 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:25.634985 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 11c0ee09-8208-4109-a310-0de171036e81] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:25.641131 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.641575 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.642352 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:25.642776 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:25.659465 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 HTTP/1.1 Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:12:25.661742 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.663547 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '11c0ee09-8208-4109-a310-0de171036e81'} Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:25.664565 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. Jun 15 15:12:25.666177 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:25.667645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 11c0ee09-8208-4109-a310-0de171036e81 could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:25.667645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-a5ce4029-8d71-4aa3-8a76-580ee452509e tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81" status: 404 len: 111 microversion: 2.1 time: 0.032917 Jun 15 15:12:25.667645 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 658/1315] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:25 2022] GET /compute/v2.1/servers/11c0ee09-8208-4109-a310-0de171036e81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:12:26.971767 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:26.972368 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.compute.api [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:26.978355 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:26.978741 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:26.979492 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:26.979919 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG oslo_concurrency.lockutils [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:26.993305 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.wsgi [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: request: DELETE /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da HTTP/1.1 Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept: application/json Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Accept-Encoding: identity Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Connection: close Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Length: 0 Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Content-Type: application/json Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Host: 10.222.0.42 Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Openstack-System-Scope: None Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Id: None Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Domain-Name: None Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Identity-Status: Confirmed Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Is-Admin-Project: True Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Id: default Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Domain-Name: Default Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Role: reader,member Jun 15 15:12:26.994830 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Roles: reader,member Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Id: default Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Domain-Name: Default Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: method: > Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: exception: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:26.996691 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: action_args: {'id': '7fef7f2a-f9c1-4903-a741-91693d3e88da'} Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: {{(pid=124659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:26.997726 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:26.999460 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: ERROR nova.api.openstack.wsgi Jun 15 15:12:27.001206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: DEBUG nova.api.openstack.wsgi [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. {{(pid=124659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:27.001206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO nova.api.openstack.requestlog [None req-5da7e2a8-0725-456f-b129-c84fd81599f8 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 404 len: 111 microversion: 2.1 time: 0.028383 Jun 15 15:12:27.001206 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: [pid: 124659|app: 0|req: 658/1316] 10.222.0.42 () {58 vars in 1238 bytes} [Wed Jun 15 15:12:26 2022] DELETE /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:12:27.005124 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Calling method '>' {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:12:27.005734 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.compute.api [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] [instance: 7fef7f2a-f9c1-4903-a741-91693d3e88da] Fetching instance by UUID {{(pid=124660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:12:27.012188 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:27.012636 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:27.013388 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:12:27.013833 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG oslo_concurrency.lockutils [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Lock "62f88910-6aa4-41b0-a16b-3521d73e0cca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:12:27.027822 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.wsgi [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] HTTP exception thrown: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Request method failure captured: Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: request: GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da HTTP/1.1 Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept: application/json Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Accept-Encoding: identity Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Connection: close Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Length: 0 Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Content-Type: application/json Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Host: 10.222.0.42 Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Openstack-System-Scope: None Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: User-Agent: python-urllib3/1.26.9 Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Auth-Token: gAAAAABiqfS9mUJR9O-8AOmZwYpIN41p933lT0pOngv5dGO0Ea_uaaSfOnkAMyZfHLm-pYqxcqEpD9a1sxR2-T7LKMOew_WrtvSV4Z3Vo4yTzmkNeQxB8HNyAu6X-bGoDqvEUsQWD9IJB7tTgO_QjZzR6iGdQNwSTeIc9IsMaS_7W0djQ1C0Yd4 Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Id: None Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Domain-Name: None Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Identity-Status: Confirmed Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Is-Admin-Project: True Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Id: default Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Domain-Name: Default Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Project-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Role: reader,member Jun 15 15:12:27.029350 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Roles: reader,member Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6829672292b4494931500de38f4d924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6829672292b4494931500de38f4d924"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6829672292b4494931500de38f4d924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Id: e6829672292b4494931500de38f4d924 Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581339550 Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Id: default Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Domain-Name: Default Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Id: 17f8c496bb0049719cd67c457ba40f35 Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: X-User-Name: tempest-AttachVolumeNegativeTest-581339550-project Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: method: > Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: exception: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:27.031081 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: action_args: {'id': '7fef7f2a-f9c1-4903-a741-91693d3e88da'} Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: {{(pid=124660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:12:27.032050 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. Jun 15 15:12:27.033730 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: ERROR nova.api.openstack.wsgi Jun 15 15:12:27.035620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: DEBUG nova.api.openstack.wsgi [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] Returning 404 to user: Instance 7fef7f2a-f9c1-4903-a741-91693d3e88da could not be found. {{(pid=124660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:12:27.035620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO nova.api.openstack.requestlog [None req-ac92a621-01ff-4382-8d47-d58d6eaa08a5 tempest-AttachVolumeNegativeTest-581339550 tempest-AttachVolumeNegativeTest-581339550-project] 10.222.0.42 "GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da" status: 404 len: 111 microversion: 2.1 time: 0.029888 Jun 15 15:12:27.035620 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: [pid: 124660|app: 0|req: 659/1317] 10.222.0.42 () {58 vars in 1235 bytes} [Wed Jun 15 15:12:26 2022] GET /compute/v2.1/servers/7fef7f2a-f9c1-4903-a741-91693d3e88da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:13:32.134706 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:13:32.135934 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 15:13:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:13:39.211692 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:13:39.212329 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Wed Jun 15 15:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:13:47.762113 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:13:47.763044 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Wed Jun 15 15:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:14:47.250945 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:14:47.251541 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 15:14:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:16:52.143309 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:16:52.144052 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 15:16:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:16:59.220995 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:16:59.221598 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Wed Jun 15 15:16:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:17:07.769769 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:17:07.770352 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Wed Jun 15 15:17:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:17:16.797038 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:17:16.797606 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 15:17:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:17:31.509522 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:17:31.510097 dv-cinder-787296-10-iscsi devstack@n-api.service[124659]: Wed Jun 15 15:17:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:18:07.259790 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:18:07.260430 dv-cinder-787296-10-iscsi devstack@n-api.service[124660]: Wed Jun 15 15:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!